openshift-spark
openshift-spark copied to clipboard
radanalyticsio
Currently we can't collect Heap or Thread Dumps easily with the spark image, having to tweak the flags manually. Would be good if there's an env var added to the...
Currently, because of the dogen/concreate tool and the fact that the Dockerfile (that is actually generated by the dogen/concreate tool, but at the same time is part of the repo(?))...
Currently used hadoop version (2.7.3) is way too old (released back in June 2017). One of the consequences is the missing support for "fs.s3a.path.style.access" property of s3a filesystem layer, which...
Added checks to verify writeability of configuration and cleaned some variable
the spark images currently use centos as their base, it would be nice to get these migrated over to use the Red Hat UBI[0] image as their base. [0] https://developers.redhat.com/products/rhel/ubi/
Thanks for providing this useful container. I have a question about two spark configs: `spark.ui.reverseProxy` and `spark.ui.reverseProxyUrl.` It seems the [official document](https://spark.apache.org/docs/latest/configuration.html) says "Use it with caution, as worker and...
Thrift server is a great thing for spark and it's already bundled in the distribution. However, in order to use in the image, I need to do some workarounds to...
As @elmiko said: `as i recall, the headless service uses a different port for connection. like the main service is for using the 7077 port to communicate with the master,...