spark-operator
spark-operator copied to clipboard
When will operator support spark 3.3.0 or above?
When will operator support spark 3.3.0 or above?
it supports 3.4, not sure about 3.5
We are using it with Spark 3.3.2 as well
We are using it with Spark 3.3.2 as well
Which version are you using that supports v3.3.2?
Which version are you using
Which version are you using
Sorry, I missed it. I read the documentation carefully today. The latest releases support Spark 2.3 and up.
So can we assume that
Spark 2.3 and up
includes all stable major versions of Spark, like 3.5? We already run it successfully with 3.3, but I'd appreciate it if the docs would give a bit more clarity on this. At least the version matrix prominently featured in the README.md implies that only 3.1.1 is supported.
I'm running the Spark 3.2.1 with the latest operator but when i use the spark-avro 3.2.0, it said i'm running on the LEGACY spark and failed the job, do you have any idea? I'm running locally within Spark 3.2.1 with library is fine.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.