Thomas Graves

confirmed the mig script with rocky aren't working anymore, they were working before pr was merged so will have to investigate

the resources are parsed before our DriverPlugin would run so we can't set this just in the plugin. It doesn't make sense to make this change in Spark because this...

the issue is fixed in 3.3 and master branch, they are working on fixing the other ones.

For 22.10 release we should concentrate on testing base functionality in Alluxio and testing: https://github.com/NVIDIA/spark-rapids/issues/6508 and if possible https://github.com/NVIDIA/spark-rapids/issues/6456

yes Databricks only is fine for 22.10

Hey @martinstuder, thanks for reporting this. We don't support databricks 7.2 runtime or AQE with the current 0.2 release. Would you be able to try with the 7.0 runtime with...

Please also turn off cbo as I don't know that we have tested with that.

thanks, I don't think the container service should matter here as long as its using the same databricks jar for 7.0 runtime. I'm trying to reproduce locally but so far...

thanks, it's great that you found what was causing this. It looks like their optimized writes is basically an adaptive shuffle, which is really similar to AQE, which unfortunately we...

I would be ok with merging a minimal working version as long as it doesn't impact many other components and destabilize the builds and other developers activities. If it doesn't...