error compilng for Spark 2.3 - SparkDataCollection.scala:30: object ApplicationEventListener is not a member of package org.apache.spark.scheduler

[Tagar]

[info] Updating {file:/opt/elephant/dr-elephant/}dr-elephant...
[info] Resolving org.jacoco#org.jacoco.agent;0.7.1.201405082137 ...
[info] Done updating.
[info] Compiling 96 Scala sources and 148 Java sources to /opt/elephant/dr-elephant/target/scala-2.10/classes...
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:30: object ApplicationEventListener is not a member of package org.apache.spark.scheduler
[error] import org.apache.spark.scheduler.{ApplicationEventListener, ReplayListenerBus, StageInfo}
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:31: object StorageStatusListener is not a member of package org.apache.spark.storage
[error] import org.apache.spark.storage.{RDDInfo, StorageStatus, StorageStatusListener, StorageStatusTrackingListener}
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:32: object EnvironmentListener is not a member of package org.apache.spark.ui.env
[error] import org.apache.spark.ui.env.EnvironmentListener
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:33: object ExecutorsListener is not a member of package org.apache.spark.ui.exec
[error] import org.apache.spark.ui.exec.ExecutorsListener
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:34: object JobProgressListener is not a member of package org.apache.spark.ui.jobs
[error] import org.apache.spark.ui.jobs.JobProgressListener
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:35: object StorageListener is not a member of package org.apache.spark.ui.storage
[error] import org.apache.spark.ui.storage.StorageListener
[error]        ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:49: not found: type ApplicationEventListener
[error]   lazy val applicationEventListener = new ApplicationEventListener()
[error]                                           ^
[error] /opt/elephant/dr-elephant/app/org/apache/spark/deploy/history/SparkDataCollection.scala:50: not found: type JobProgressListener
[error]   lazy val jobProgressListener = new JobProgressListener(new SparkConf())

[ayush-chauhan]

Were you able to solve this issue?

[Tagar]

Nope

Curious if somebody was able to compile Dr.Elephant with Cloudera?

[t2hw]

Is this project still under maintenance? LOL

[nikunjbhartia]

@Tagar , did you change the play version from 2.2.2 to 2.3.2 in plugins.sbt ?

[nikunjbhartia]

core/src/main/scala/org/apache/spark/scheduler/ApplicationEventListener.scala was removed while migration from spark 2.2.1 to 2.3.0 ! Guess I will have to try to build on spark 2.2.1 and pray it works with spark 2.3