homebrew-core icon indicating copy to clipboard operation
homebrew-core copied to clipboard

apache-spark: fix used java version

Open robsonpeixoto opened this issue 1 year ago • 2 comments

  • [x] Have you followed the guidelines for contributing?
  • [x] Have you ensured that your commits follow the commit style guide?
  • [x] Have you checked that there aren't other open pull requests for the same formula update/change?
  • [x] Have you built your formula locally with brew install --build-from-source <formula>, where <formula> is the name of the formula you're submitting?
  • [x] Is your test running fine brew test <formula>, where <formula> is the name of the formula you're submitting?
  • [x] Does your build pass brew audit --strict <formula> (after doing brew install --build-from-source <formula>)? If this is a new formula, does it pass brew audit --new <formula>?

Referencies:

  • https://spark.apache.org/docs/3.3.0/
  • https://books.japila.pl/pyspark-internals/Setup/

robsonpeixoto avatar Jul 21 '22 12:07 robsonpeixoto

I need a help with it: https://github.com/Homebrew/homebrew-core/pull/106315/files#diff-bce855593d4d586a36dfa3283b1e56aed7084676ec421d5e945966901a716bdaR25 How can I do it?

robsonpeixoto avatar Jul 21 '22 12:07 robsonpeixoto

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

github-actions[bot] avatar Aug 11 '22 13:08 github-actions[bot]

So does it not actually work? Or does upstream just suggest to use the LTS?

SMillerDev avatar Aug 24 '22 07:08 SMillerDev

Is a upstream suggestion:

Spark runs on Java 8/11/17, Scala 2.12/2.13, Python 3.7+ and R 3.5+. Java 8 prior to version 8u201 support is deprecated as of Spark 3.2.0. For the Scala API, Spark 3.3.0 uses Scala 2.12. You will need to use a compatible Scala version (2.12.x).

References:

  • https://spark.apache.org/docs/3.2.0/ => Spark runs on Java 8/11 ...
  • https://spark.apache.org/docs/3.3.0/ => Spark runs on Java 8/11/17 ...

robsonpeixoto avatar Aug 24 '22 10:08 robsonpeixoto

Seeing how we only downgrade dependencies that are broken I don't think we want to merge this.

SMillerDev avatar Aug 24 '22 11:08 SMillerDev