spark-on-kubernetes-docker

spark-on-kubernetes-docker copied to clipboard

added curl to livy image

1

fixes https://github.com/JahstreetOrg/spark-on-kubernetes-helm/issues/71

teplydat

Adding curl to livy-spark image

3

This example list under [https://github.com/JahstreetOrg/spark-on-kubernetes-helm] does not work because curl is not present in image. ``` kubectl exec --namespace livy livy-0 -- \ curl -s -k -H 'Content-Type: application/json' -X...

manjiler

Not all Spark configurations are supported by the mask

1

The 4th container mask isn't currently supported, as the property does not get mapped to a Spark configuration. Specifically: https://github.com/jahstreet/spark-on-kubernetes-docker/blob/1dc45d3053d1cf7689e9ba07c7270a52f2a16aa9/livy/0.7.0-incubating-spark_2.4.5_2.11-hadoop_3.1.0_cloud/entrypoint.sh#L47 Per the 4th mask, lower case LIVY_SPARK should be picked...

marcjimz