dr-elephant
dr-elephant copied to clipboard
Compilation error spark 2.2.3 and hadoop 2.7
Hi,
I am first time trying to use dr-elephant. Trying to compile on mac and failing with below: Command is: play -Dhadoopversion=2.7.0 -Dsparkversion=2.2.3 -Dsbt.repository.config=app-conf/resolver.conf clean compile test activator is ~/Development/Tools/activator-dist-1.3.12//bin/activator [info] Loading global plugins from ~/.sbt/0.13/plugins [info] Loading project definition from ~/Development/workspace/git/dr-elephant/dr-elephant/project [error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:17: object Project is not a member of package play [error] import play.Project._ [error] ^ [error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value javaJdbc [error] var dependencies = Seq(javaJdbc, javaEbean, cache) [error] ^ [error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value javaEbean [error] var dependencies = Seq(javaJdbc, javaEbean, cache) [error] ^ [error] ~/Development/workspace/git/dr-elephant/dr-elephant/project/Dependencies.scala:102: not found: value cache [error] var dependencies = Seq(javaJdbc, javaEbean, cache) [error] ^ [error] four errors found [error] (compile:compile) Compilation failed
Appreciate any help.
Thanks, Ravi Papisetti
dr.elephant不支持spark2.x以上版本,所以有些spark依赖和jar包会出错,我尝试过很多方法来解决dr.elephant对spark2.x的支持,但是还是没有成功
@Mr88Chen 现在有什么进展吗?我也在尝试编译spark 2.3版本,没有成功。