spline-spark-agent icon indicating copy to clipboard operation
spline-spark-agent copied to clipboard

Support for spark 3.5

Open igreenfield opened this issue 1 year ago • 1 comments

Can you add support for spark 3.5.X

igreenfield avatar Nov 29 '23 15:11 igreenfield

Sure, right after #705 I guess. Unfortunately the team is at zero capacity at the moment. Hoping for community help.

wajda avatar Nov 29 '23 15:11 wajda

Hello there. Will you add support of spark 3.5.x this?

dishkakrauch avatar Aug 21 '24 11:08 dishkakrauch

I can give it a quick try. But if there are braking changes that need to be addressed I hardly likely to be able to find time for this till the end of the year. Any help/PR is appreciated of course. Let me try and see.

wajda avatar Aug 21 '24 15:08 wajda

@igreenfield, @dishkakrauch I've created a PR. The integration tests passed, but I didn't test it with any real Spark setup. Can you test it if works in your real-life cases please?

You can download the agent bundles here:

  • Scala 2.11 - https://teamcity.jetbrains.com/buildConfiguration/OpenSourceProjects_AbsaOSS_SplineAgentSpark_AutoBuildArtifactsSparkScala211/4763292?buildTab=artifacts
  • Scala 2.12 - https://teamcity.jetbrains.com/buildConfiguration/OpenSourceProjects_AbsaOSS_SplineAgentSpark_AutoBuildArtifactsSparkScala212/4763294?buildTab=artifacts

wajda avatar Aug 23 '24 23:08 wajda

@igreenfield, @dishkakrauch I've created a PR. The integration tests passed, but I didn't test it with any real Spark setup. Can you test it if works in your real-life cases please?

You can download the agent bundles here:

  • Scala 2.11 - https://teamcity.jetbrains.com/buildConfiguration/OpenSourceProjects_AbsaOSS_SplineAgentSpark_AutoBuildArtifactsSparkScala211/4763292?buildTab=artifacts
  • Scala 2.12 - https://teamcity.jetbrains.com/buildConfiguration/OpenSourceProjects_AbsaOSS_SplineAgentSpark_AutoBuildArtifactsSparkScala212/4763294?buildTab=artifacts

Sure, why not.

dishkakrauch avatar Aug 29 '24 13:08 dishkakrauch

It's worked. Thank you.

dishkakrauch avatar Sep 18 '24 09:09 dishkakrauch