spark-ec2 icon indicating copy to clipboard operation
spark-ec2 copied to clipboard

"--spark-version" does not work

Open wangshusen opened this issue 7 years ago • 1 comments

If I don't specify "--spark-version", the "/root/spark/" directory contains nothing but "/conf/".

When I specify "--spark-version=2.0.0", "--spark-version=2.0.2", "--spark-version=2.1.0", or "--spark-version=2.2.0", the error is like

Don't know about Spark version: 2.0.0

and spark-ec2 does not launch EC2 clusters.

But when I specify "--spark-version=1.4.1", it works fine.

I need to use Spark version after 2.0. Please help!

wangshusen avatar Aug 10 '17 19:08 wangshusen

The issue is solved by using branch-2.0.

git clone -b branch-2.0 https://github.com/amplab/spark-ec2.git

wangshusen avatar Aug 10 '17 21:08 wangshusen