guacamole icon indicating copy to clipboard operation
guacamole copied to clipboard

Published 20 hours ago • verified publisher icon hammerlab

Move to Spark 2.0

Open arahuja opened this issue 8 years ago • 2 comments

It seems like this will involve:

  • removing/moving references org.apache.spark.logging
  • upgrading ADAM
  • upgrading spark-testing-base to 2.0.0_0.4.4

@ryan-williams have you tried this out already, I remember you were looking at the ADAM upgrade

arahuja avatar Sep 01 '16 18:09 arahuja

I haven't paid much attention to their 2.0.0-upgrade efforts yet, so I don't have a good sense of what that will entail.

ryan-williams avatar Sep 01 '16 18:09 ryan-williams

I haven't paid much attention to their 2.0.0-upgrade efforts yet, so I don't have a good sense of what that will entail.

They're pretty simple. It's mostly been POM/CI changes thus far, as well as moving away from org.apache.spark.Logging. The big impacts were that there were a variety of methods that were deprecated in Spark 1.x that got removed, and then org.apache.spark.Logging got removed.

fnothaft avatar Sep 01 '16 18:09 fnothaft