spark-kubernetes-operator

spark-kubernetes-operator copied to clipboard

[SPARK-48017] Add Spark application submission worker for operator

4

### What changes were proposed in this pull request? This is a breakdown PR of #2 - adding a submission worker implementation for SparkApplication. ### Why are the changes needed?...

jiangzho

Operator 0.1.0

12

### What changes were proposed in this pull request? This PR proposes Spark Operator v1.0.0-alpha, which supports operating Spark Applications on k8s. Please also refer README & docs for design...

jiangzho

[SPARK-48382]Add controller / reconciler module to operator

1

### What changes were proposed in this pull request? This PR adds the operator module for Spark operator, makes it able to operate and reconcile SparkApplications () in Kubernetes cluster,...

jiangzho

[SPARK-49329] Support user provided spec for SparkCluster

1

### What changes were proposed in this pull request? This PR introduces the feature to enable user-provided metadata & spec for Spark Clusters. ### Why are the changes needed? Similar...

jiangzho

[SPARK-49331][FOLLOWUP] Fix `cpu` to `cpus` in `setup-minikube` setting

4

### What changes were proposed in this pull request? This PR is a follow-up of the following PR to fix `cpu` to `cpus` in `setup-minikube` setting. - #82 ### Why...

dongjoon-hyun

### What changes were proposed in this pull request? This pull request updates the schema definitions in `build-tools/helm/spark-kubernetes-operator/values.schema.json` to improve compatibility with Kubernetes conventions. The main change is updating the...

Sbaia

[SPARK-53457] Expose fabric8 dependencies as api for downstream users

7

### What changes were proposed in this pull request? This PR exposes fabric8 dependencies as api in gradle build and hence in pom ### Why are the changes needed? Our...

jiangzho