Leonard Aukea
Leonard Aukea
@timvink feel free to do it if you want 😄. I'm a bit busy anyways. I would love for this plugin to be functional with interactive plots :)
I've been trying to get `DEBUG` logs out of driver in the hope of gaining more insight in the issue by setting: ```yaml spec: sparkConfigMap: log4j-props ``` and generating the...
I found that for k8s 1.19.1, the kubernetes-client has to be of a version greater than >= 4.13.1 [compatibility-matrix](https://github.com/fabric8io/kubernetes-client/blob/master/README.md#compatibility-matrix). Looking at the deps in 1.3 branch for spark I see...
Seems like an updated dept version was just added to master: https://github.com/apache/spark/blob/6f2ffccb5e17b5ee92003c86b7ec03c5344105c3/dev/deps/spark-deps-hadoop-3.2-hive-2.3#L128
The issue remains even after testing with building spark from master. Got debug logs set up as well for further details: ``` 21/06/09 08:31:21 WARN NativeCodeLoader: Unable to load native-hadoop...
So the issue is related to https://github.com/fabric8io/kubernetes-client/issues/2212#issuecomment-628551315 In order to make it work. we had to add the following to the spark-operator, driver & executor: ```yaml env: - name: HTTP2_DISABLE...
This would be a good extension