twitter-sentiment-analysis icon indicating copy to clipboard operation
twitter-sentiment-analysis copied to clipboard

Published 20 hours ago • verified publisher icon vspiewak

Docker - Spark installation problem

Open eravion opened this issue 8 years ago • 4 comments

Hello,

I download last version if git and I have this issue : Can you help me ?

docker-compose build Building elasticsearch Step 1 : FROM elasticsearch:2.1.1 ---> 6f609da577b7 Step 2 : MAINTAINER vspiewak ---> Using cache ---> c2287a0451fa Step 3 : ENV PATH /usr/share/elasticsearch/bin:$PATH ---> Using cache ---> b90d29d86c3a Step 4 : RUN plugin install mobz/elasticsearch-head ---> Using cache ---> 2e45724c17af Successfully built 2e45724c17af Building spark Step 1 : FROM java:8 ---> 6c9a006fd38a Step 2 : MAINTAINER vspiewak ---> Using cache ---> 1cb8abf01c10 Step 3 : WORKDIR /opt ---> Using cache ---> 5a1a9f990453 Step 4 : ENV SPARK_VERSION 1.5.2 ---> Using cache ---> c2b58646147e Step 5 : RUN curl -o spark.tgz http://d3kbcqa49mib13.cloudfront.net/spark-$SPARK_VERSION.tgz ---> Using cache ---> cdcc4a3cb188 Step 6 : RUN tar xvzf spark.tgz ---> Using cache ---> 10f720c58dc4 Step 7 : RUN rm spark.tgz ---> Using cache ---> ea879762a036 Step 8 : RUN ln -s spark-$SPARK_VERSION spark ---> Using cache ---> 3ae136d6e56e Step 9 : WORKDIR spark ---> Using cache ---> 87283edd276f Step 10 : RUN sbt/sbt assembly ---> Running in 60e6788f38de NOTE: The sbt/sbt script has been relocated to build/sbt. Please update references to point to the new location.

  Invoking 'build/sbt assembly' now ...

Using /usr/lib/jvm/java-8-openjdk-amd64 as default JAVA_HOME. Note, this will be overridden by -java-home if it is set. Attempting to fetch sbt Our attempt to download sbt locally to build/sbt-launch-0.13.7.jar failed. Please install sbt manually from http://www.scala-sbt.org/ ERROR: Service 'spark' failed to build: The command '/bin/sh -c sbt/sbt assembly' returned a non-zero code: 255

eravion avatar May 10 '16 18:05 eravion

Are you still seeing the error?

lovelylavs avatar May 20 '16 14:05 lovelylavs

Yes.

eravion avatar May 24 '16 20:05 eravion

Well, I actually don't see that error in Ubuntu 16.04, the build process seemed to get to the very end, only to fail. I am rerunning it right now, what seemed worrisome was that some twitter library towards the middle of the build was not to be found, as well as the immediately next library. Was it really necessary to hardwire all those version numbers? Can the build process recover from "error] SERVER ERROR: Service Temporarily Unavailable url=http://maven.twttr.com/org/apache/hadoop/hadoop-yarn-server/2.2.0/hadoop-yarn-server-2.2.0.jar" , or will that be another 30 minutes building from scratch, after I am forced to restart the build? Thanks anyway, will be great to make it work again!

reppolice avatar Jul 20 '16 13:07 reppolice

Facing the same issue as outlined at the very start here. It doesn't work after Invoking 'build/sbt assembly' now ...

ishantanu avatar Nov 17 '16 18:11 ishantanu