spark-operator icon indicating copy to clipboard operation
spark-operator copied to clipboard

Need custom spark image dockerfile

Open kraj007 opened this issue 2 years ago • 3 comments
trafficstars

I am looking for custom spark docker image , which runs perfectly on spark-on-k8s-operator. I found few dockerfile but all have some problems. Can anybody here please help on this

kraj007 avatar Apr 14 '23 19:04 kraj007

@kraj007 You can change docker image in helm install for Spark operator: https://googlecloudplatform.github.io/spark-on-k8s-operator/#version-matrix

However you really don't have to use Spark Image installed with Spark Operator to build your Spark applications. I have been using latest Binami Spark images for building Spark Applications - that are managed through Spark Operator.

JTBS avatar Apr 18 '23 17:04 JTBS

@JTBS So do you recommend using bitnami images in production ? do they have any issues so far ? i can see they are licensed under apache 2.0 license so should be free to use

rajeshkatkarnice avatar Apr 18 '23 18:04 rajeshkatkarnice

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Aug 14 '24 06:08 github-actions[bot]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

github-actions[bot] avatar Sep 03 '24 06:09 github-actions[bot]