sparklens icon indicating copy to clipboard operation
sparklens copied to clipboard

Published 20 hours ago • verified publisher icon qubole

Release for Scala 2.12

Open janekdb opened this issue 4 years ago • 5 comments

Hi,

Any plans to release for Scala 2.12?

Scala 2.13 and Spark 3 would be good to have support for.

Thanks, Janek

janekdb avatar Feb 03 '21 18:02 janekdb

Just change Scala and Spark versions in build.sbt and rebuild the package with sbt compile && sbt package Scala 2.12 and Spark 2.4.0 worked for me.

oleksiilopasov avatar Feb 06 '21 08:02 oleksiilopasov

Does Qubole have any plans to release a build like that to spark-packages?

conrosebraugh avatar Jun 14 '21 23:06 conrosebraugh

Hey, any update on this topic?

sergialonsaco avatar Jul 19 '22 07:07 sergialonsaco

Scala 2.12 support would be nice. For myself, i'm using GCP DataProc with an image of Apache Spark 3.1.3 and Scala 2.12.14. https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-2.0

Having sparklens as a supported listener solution in this environment with an emailed report would be really nice, because my organization tends to restrict FW rules aggressively that makes it very difficult to utilize many of the UI based diagnostic tools.

Just change Scala and Spark versions in build.sbt and rebuild the package with sbt compile && sbt package Scala 2.12 and Spark 2.4.0 worked for me. @oleksiilopasov thanks, but this did not work for me. Compilation failed, SparkHadoopUtil is not longer accessible, along with some other errors.

markballenger avatar Oct 04 '22 16:10 markballenger