distributed-extraction-framework icon indicating copy to clipboard operation
distributed-extraction-framework copied to clipboard
verified publisher icon dbpedia

Partial Spark 1.3.0 update

Open gone-phishing opened this issue 10 years ago • 3 comments

Though the code compiles for spark 1.3.0 with hadoop 2.5.2, a lot of dependency issues needs to be fixed. We can have a separate branch for these updates

gone-phishing avatar Apr 07 '15 22:04 gone-phishing

Pushing a few more commits that resolves multiple scala version warnings. There are still overlapping jars warnings present, and I've tried excluding a few of them by adding exclusions in the pom file, but then they don't have any effect on compilation and they can simply be ignored.

gone-phishing avatar Apr 09 '15 22:04 gone-phishing

any updates on this?

intracer avatar Oct 16 '15 06:10 intracer

parallel downloads using akka clustering and extraction of information using apache spark is well supported at this stage. Are there any issues ?

gone-phishing avatar Oct 16 '15 06:10 gone-phishing