spark-operator
spark-operator copied to clipboard
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Installing spark operator failed [ref](https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/volcano-integration.md) ``` $ helm repo add incubator http://storage.googleapis.com/kubernetes-charts-incubator ``` maybe need update as `README.md` ``` helm repo add spark-operator https://googlecloudplatform.github.io/spark-on-k8s-operator ```
Hello! I noticed that logs in all pods (operator/driver/executor) are streamed to stderr. In my opinion this is incorrect, because they're marked as errors in the stackdriver.
I am running spark structure streaming on k8s. when the job is idle the memory uses of the executor pods is not coming down. is the running pod release memory...