Onur Satici

@lovasoa does this seem like the right approach to you? I wanted to keep the previous behaviour of not generating a schema for a generic dataclass if it does not...

Sorry for the delay here, I will take a look to the mypy complaint and will see if it is low lift to support nested generic dataclasses. It might take...

Hello @Gouthamkreddy1234 , how are you mounting the config file? by default the built container will use the config located at `/opt/palantir/services/spark-scheduler/var/conf/install.yml` checkout the example podspec here: https://github.com/palantir/k8s-spark-scheduler/blob/master/examples/extender.yml#L127

thanks for the info @Gouthamkreddy1234. Strange, altering the configmap should work. Can you verify that `/opt/palantir/services/spark-scheduler/var/conf/install.yml` has your changes when you do `kubectl apply -f examples/extender.yml` by ssh'ing into the...

got it, finally, can you check if the pods you are creating have `spark-scheduler` as the `schedulerName` in their spec? you can also use this script to simulate a spark...

Hey @Gouthamkreddy1234 had a look at this. So within the extender, it is assumed that nodes have a configurable label, and the value of this label dictates which group a...

I can confirm that with that change, if I submit a large application with: ```bash # 10^10 cpu requests for the driver, this will be stuck Pending ./submit-test-spark-app.sh 1 2...

Unfortunately spark scheduler extender currently doesn't support launching client mode applications to kubernetes. It assumes that a driver will be launched in the cluster, which then proceeds to request executors....

Hey @boryssemeniuk thanks for the flag. Yes you are right that as long as the resource reservation object exists it will be considered for scheduling decisions. They have an owner...

Hey @Gouthamkreddy1234 , I don't have resources to support non spark work loads unfortunately. That being said, happy to accept any contributions. Currently the extender relies on some labels to...