scalding
scalding copied to clipboard
twitter
A Scala API for Cascading
make sure the cascading branch is up to date with develop cc @rubanm @fwbrasil
Fix Jline dependency to avoid the following error when launching scalding-repl in hdfs-mode: Failed to created JLineReader: java.lang.NoClassDefFoundError: scala/tools/jline/console/completer/Completer
This fixes the missing libraries when running in hdfs mode.
Is there anyone here to help me please? There is no response to the mail from TwitterIs there anyone here to help me please? There is no response to the...
If you parse through https://oss.sonatype.org/content/repositories/snapshots/com/twitter/scalding-hadoop-test_2.11/0.18.0-RC3-1-a0516e0f-SNAPSHOT/scalding-hadoop-test_2.11-0.18.0-RC3-1-a0516e0f-SNAPSHOT.pom you can see that `scm` is duplicated twice. This causes some issues with automated ingestion tools such as artifactory maven proxy. the ingestion crash is:...
``` .[info] - all optimization rules do not increase steps *** FAILED *** [1435](https://github.com/twitter/scalding/runs/5505683474?check_suite_focus=true#step:7:1435) [info] TestFailedException was thrown during property evaluation. [1436](https://github.com/twitter/scalding/runs/5505683474?check_suite_focus=true#step:7:1436) [info] Message: 2 was not greater than or...
See comment in https://github.com/twitter/scalding/pull/1996#issuecomment-1112460967
**Is your feature request related to a problem? Please describe.** Currently scalding-spark only supports a few scalding sources/sinks. I am interested in adding support for some more common use cases....