spark-ec2
spark-ec2 copied to clipboard
"--spark-version" does not work
If I don't specify "--spark-version", the "/root/spark/" directory contains nothing but "/conf/".
When I specify "--spark-version=2.0.0", "--spark-version=2.0.2", "--spark-version=2.1.0", or "--spark-version=2.2.0", the error is like
Don't know about Spark version: 2.0.0
and spark-ec2 does not launch EC2 clusters.
But when I specify "--spark-version=1.4.1", it works fine.
I need to use Spark version after 2.0. Please help!
The issue is solved by using branch-2.0.
git clone -b branch-2.0 https://github.com/amplab/spark-ec2.git