docker-spark-cluster icon indicating copy to clipboard operation
docker-spark-cluster copied to clipboard

http://apache.mirror.iphh.net/spark/spark-2.4.0/spark-2.4.0-bin-hadoop2.7.tgz is removed.

Open iknowchang opened this issue 6 years ago • 5 comments

Step 10/10 : RUN wget --no-verbose http://apache.mirror.iphh.net/spark/spark-${SPARK_VERSION}/spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz && tar -xvzf spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz       && mv spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION} spark       && rm spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz
 ---> Running in f077b663eab8
http://apache.mirror.iphh.net/spark/spark-2.4.0/spark-2.4.0-bin-hadoop2.7.tgz:
2019-04-06 16:22:07 ERROR 404: Not Found.
The command '/bin/sh -c wget --no-verbose

iknowchang avatar Apr 06 '19 16:04 iknowchang

SPARK_VERSION=2.4.1 is available for docker/base/Dockerfile file.

iknowchang avatar Apr 06 '19 23:04 iknowchang

write the updated version, currently its 2.4.3 so, write this: http://apache.mirror.anlx.net/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz

arslanmujeeb avatar Aug 27 '19 11:08 arslanmujeeb

Looks like it is updated again - it is now: http://apache.mirror.anlx.net/spark/spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz

Need to update ENV SPARK_VERSION=2.4.4 in docker/base/Docker file

djarami avatar Oct 01 '19 11:10 djarami

SPARK_VERSION is updated again. Updated link - http://apache.mirror.anlx.net/spark/spark-2.4.5/spark-2.4.5-bin-hadoop2.7.tgz Update ENV SPARK_VERSION=2.4.5 in docker/base/Docker file

Praneet9 avatar Apr 08 '20 03:04 Praneet9

Is there another version, as 2.4.5 is also not working now

rajdipr-dataman avatar May 18 '21 11:05 rajdipr-dataman