scalding
scalding copied to clipboard
Repl seems broken in local mode
There is also a mailing list thread:
https://groups.google.com/forum/#!topic/scalding-dev/y582r5zmr18
I guess a dependency is missing from the repl. We have a test, but the approach to run it is not just calling run --local
on the repl target.
t-oscar1:scalding oscar$ ./sbt "scalding-repl/run --local"
[info] Loading project definition from /Users/oscar/oss/scalding/project
[info] Set current project to scalding (in build file:/Users/oscar/oss/scalding/)
[info] Running com.twitter.scalding.ScaldingShell --local
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[error] (run-main-0) java.lang.NoClassDefFoundError: cascading/flow/FlowConnector
java.lang.NoClassDefFoundError: cascading/flow/FlowConnector
at com.twitter.scalding.Mode$.apply(Mode.scala:87)
at com.twitter.scalding.BaseScaldingShell$class.parseModeArgs(ScaldingShell.scala:117)
at com.twitter.scalding.ScaldingShell$.parseModeArgs(ScaldingShell.scala:196)
at com.twitter.scalding.BaseScaldingShell$class.process(ScaldingShell.scala:66)
at com.twitter.scalding.ScaldingShell$.process(ScaldingShell.scala:196)
at com.twitter.scalding.BaseScaldingShell$class.main(ScaldingShell.scala:127)
at com.twitter.scalding.ScaldingShell$.main(ScaldingShell.scala:196)
at com.twitter.scalding.ScaldingShell.main(ScaldingShell.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
Caused by: java.lang.ClassNotFoundException: cascading.flow.FlowConnector
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.twitter.scalding.Mode$.apply(Mode.scala:87)
at com.twitter.scalding.BaseScaldingShell$class.parseModeArgs(ScaldingShell.scala:117)
at com.twitter.scalding.ScaldingShell$.parseModeArgs(ScaldingShell.scala:196)
at com.twitter.scalding.BaseScaldingShell$class.process(ScaldingShell.scala:66)
at com.twitter.scalding.ScaldingShell$.process(ScaldingShell.scala:196)
at com.twitter.scalding.BaseScaldingShell$class.main(ScaldingShell.scala:127)
at com.twitter.scalding.ScaldingShell$.main(ScaldingShell.scala:196)
at com.twitter.scalding.ScaldingShell.main(ScaldingShell.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
[trace] Stack trace suppressed: run last scalding-repl/unprovided:run for the full output.
java.lang.RuntimeException: Nonzero exit code: 1
at scala.sys.package$.error(package.scala:27)
[trace] Stack trace suppressed: run last scalding-repl/*:run for the full output.
[error] (scalding-repl/*:run) Nonzero exit code: 1
[error] Total time: 3 s, completed Oct 26, 2016 7:12:53 AM