docker-spark-cluster
                                
                                 docker-spark-cluster copied to clipboard
                                
                                    docker-spark-cluster copied to clipboard
                            
                            
                            
                        http://apache.mirror.iphh.net/spark/spark-2.4.0/spark-2.4.0-bin-hadoop2.7.tgz is removed.
Step 10/10 : RUN wget --no-verbose http://apache.mirror.iphh.net/spark/spark-${SPARK_VERSION}/spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz && tar -xvzf spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz       && mv spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION} spark       && rm spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz
 ---> Running in f077b663eab8
http://apache.mirror.iphh.net/spark/spark-2.4.0/spark-2.4.0-bin-hadoop2.7.tgz:
2019-04-06 16:22:07 ERROR 404: Not Found.
The command '/bin/sh -c wget --no-verbose
SPARK_VERSION=2.4.1 is available for docker/base/Dockerfile file.
write the updated version, currently its 2.4.3 so, write this: http://apache.mirror.anlx.net/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
Looks like it is updated again - it is now: http://apache.mirror.anlx.net/spark/spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz
Need to update ENV SPARK_VERSION=2.4.4 in docker/base/Docker file
SPARK_VERSION is updated again.
Updated link - http://apache.mirror.anlx.net/spark/spark-2.4.5/spark-2.4.5-bin-hadoop2.7.tgz
Update ENV SPARK_VERSION=2.4.5  in docker/base/Docker file
Is there another version, as 2.4.5 is also not working now