Comments (3)
If this feature is approved, it can be assigned to me.
from seatunnel.
you can deploy the cluster and setup spark home to spark lib dir or mount spark lib to /opt/spark
then you can submit to spark on k8s.
from seatunnel.
you can deploy the cluster and setup spark home to spark lib dir or mount spark lib to
/opt/spark
then you can submit to spark on k8s.
However, relying solely on native spakr-submit
is not advisable. It only creates the naked pods, which is not recommended by k8s official, and lacks some essential components such as services and ingresses. It might not suffice for production scenarios.
from seatunnel.
Related Issues (20)
- [Feature][Transform] Read the data source specified field rules into the corresponding table HOT 1
- [Bug] [Doris Sink] Sink Doris Error
- [Bug] [connector-iceberg] Illegal provider-class name: org.apache.seatunnel.shade.connector-iceberg.org.apache.orc.impl.CryptoUtils$HadoopKeyProviderFactory
- please give a eg from kafka to console use jsonpath
- [Bug] [seatunnel-engine-server] #5191 bugfix bring loss job
- [Bug] [seatunnel-engine-server] slot申请时如果资源不够,已申请成功的资源未释放 HOT 6
- [BUG][Jdbc][Oracle]ErrorCode:[COMMON-06], ErrorDescription:[Illegal argument] - The current field is DecimalType containing decimals: 18 Unable to support HOT 1
- [Bug] [shell client] variable not correct when it has space, eg: -i dt="2024-04-28 00:00:00" HOT 9
- [Feature][Connector-V2] Dependency conflicts exist in connector-cdc-sqlserver and connector-maxcompute. HOT 1
- [Feature][Catalog] Catalog API Upgrade Feature
- [Bug] [Source Jdbc] Source Jdbc Error
- [Bug] [Source][MySQL-CDC] compatible debezium json format npe issue HOT 1
- [Bug] [dev branch] Version 2.3.5 of dev packages and runs on the server with an error message HOT 3
- 创建postgresql数据源测试连接失败,报错No suitable driver found HOT 1
- [Bug] [OSS Checkpoint] OSS checkpoint not working HOT 2
- [Feature][Hbase] Implement Hbase connector catalog and typeconverter
- Does synchronized block required for method "addMetric(String name, Metric metric)" in "AbstractMetricsContext" class?
- JVM Memory Increase in Seatunnel
- [Bug] [mysql-cdc] stop.mode = 'specific' Not Worked.
- Minio
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seatunnel.