zeppelin icon indicating copy to clipboard operation
zeppelin copied to clipboard

please add scala3 interpreter ,so important for storch deep learning framework and open the github issue dashborad

Open mullerhai opened this issue 7 months ago • 8 comments

What is this PR for?

A few sentences describing the overall goals of the pull request's commits. First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html

What type of PR is it?

Bug Fix Improvement Feature Documentation Hot Fix Refactoring Please leave your type of PR only

Todos

  • [ ] - Task

What is the Jira issue?

  • Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
  • Put link here, and add [ZEPPELIN-Jira number] in PR title, eg. [ZEPPELIN-533]

How should this be tested?

  • Strongly recommended: add automated unit tests for any new or changed behavior
  • Outline any manual steps to test the PR here.

Screenshots (if appropriate)

Questions:

  • Does the license files need to update?
  • Is there breaking changes for older versions?
  • Does this needs documentation?

mullerhai avatar May 13 '25 07:05 mullerhai

@mullerhai Hello, thank you for your contribution to Apache Zeppelin. By the way, I think it's not a minor issue, so could you please create an issue first and fill out the description, including why you need a new Scala 3 interpreter, not extending Spark Interpreter? At the code level, you need to clean up commented code and add test cases for your implementation. Could you please check https://zeppelin.apache.org/contribution/contributions.html? It's a bit old document, but it helps you figure out the contribution

jongyoul avatar May 13 '25 07:05 jongyoul

@mullerhai Hello, thank you for your contribution to Apache Zeppelin. By the way, I think it's not a minor issue, so could you please create an issue first and fill out the description, including why you need a new Scala 3 interpreter, not extending Spark Interpreter? At the code level, you need to clean up commented code and add test cases for your implementation. Could you please check https://zeppelin.apache.org/contribution/contributions.html? It's a bit old document, but it helps you figure out the contribution

HI, now we have scala version pytorch named storch is exhance all thing from cpp libtorch by javacpp, but the storch only support scala3 https://github.com/mullerhai/storch , now all spark interpreter in zeppelin only support scala 2.11 2.12 2.13, they are not suitable for storch ,so can not use spark interpreter to extend.
now we want to use zeppelin for deep learning notebook as jupyter for python . but zeppelin only support scala 2.* ,

we must support scala3 eagerly , scala 2.* is too old by the way , we must open the issue dashboard for everyone to make issue for you team so you could listen what the user care about

mullerhai avatar May 13 '25 09:05 mullerhai

@mullerhai Hello, thank you for your contribution to Apache Zeppelin. By the way, I think it's not a minor issue, so could you please create an issue first and fill out the description, including why you need a new Scala 3 interpreter, not extending Spark Interpreter? At the code level, you need to clean up commented code and add test cases for your implementation. Could you please check https://zeppelin.apache.org/contribution/contributions.html? It's a bit old document, but it helps you figure out the contribution

another querestion , does zeppelin 0.12.0 support jdk 24? , I meet error when do that ,syntax error @[1,1]

mullerhai avatar May 13 '25 10:05 mullerhai

does zeppelin 0.12.0 support jdk 24?

No

Reamer avatar May 22 '25 12:05 Reamer

So the ask here is for a Scala interpreter that omits Spark? Spark does not support Scala 3.

For Scala 3, there is https://scala-cli.virtuslab.org/ - an interpreter could be potentially built around that but the main need would be for a volunteer to take it on.

pjfanning avatar Jul 03 '25 15:07 pjfanning

@mullerhai I'm not good at Scala 3 and storch, but the Zeppelin community is open for a new interpreter. Please feel free to suggest the new one to the dev@ and/or users@ to work together.

jongyoul avatar Jul 12 '25 13:07 jongyoul

@mullerhai I'm not good at Scala 3 and storch, but the Zeppelin community is open for a new interpreter. Please feel free to suggest the new one to the dev@ and/or users@ to work together.

thanks ,zeppelin is perfect tools, I have use for 8 years, zeppelin support data analysis, now Storch is powerful deep learning on scala3 , if zeppelin want to becomme scala-jupyter, please support scala3 and storch. I am not good at scala3 interpreter. just want to talk with you . I think your team need talk about this .thanks

mullerhai avatar Jul 12 '25 13:07 mullerhai

I raised https://github.com/sbrunk/storch/discussions/87

pjfanning avatar Jul 12 '25 13:07 pjfanning