spark-ec2

spark-ec2 copied to clipboard

branch-2.0 should use scala 2.11

2

http://spark.apache.org/downloads.html says: > Note: Starting version 2.0, Spark is built with Scala 2.11 by default. Scala 2.10 users should download the Spark source package and build with Scala 2.10 support....

matthewadams

Getting InvalidClassException when running SparkPi example locally but pointing to master on AWS

2

I'm getting the error below when attempting to `bin/run-example --master spark://ec2-000-000-000-000.compute-1.amazonaws.com:7077 SparkPi 10` from my local machine (ips changed to protect the innocent). This was run with a custom build/distribution...

matthewadams

Cannot run tasks on two differnet nodes

3

HI all i am creating an ec2 cluster using 2.0 branch. The cluster is created with 4 cores When created, i am connecting to each slave , kicking off exactly...

mmistroni

anfeng

Hadoop 2.6 support for Spark 1.6

4

Is there any reason that you only support Hadoop 2.4 for Spark 1.6? It will be lovely if you could also support Hadoop 2.6.

anfeng

Spark 2.1 Supported?

2

Is Spark 2.1 supported? It is not in the VALID_SPARK_VERSIONS in branch-2.0. What changes are needed for spark_ec2.py to support Spark 2.1?

shiyuangu

HI is there a mailing list for this project? or at least few email addresses i can contact when i find issues? I'd rather not waste your useful time by...

mmistroni

add java 8 to image creation script; remove duplication

8

denbkh

Connection to web UI broken for 1.6.2.

1

After the cluster is launched. I tried to connect to the web UI by: http://:8080 But it does not work. I checked the security groups, it seems the port 8080...

yuanfang2007

Using spark_version='1.6.2' results in partial installation (?)

10

Specifically, I get these messages during launch of the cluster, and these files are indeed not in place once the cluster starts up: ``` ./spark-ec2/spark-standalone/setup.sh: line 22: /root/spark/bin/stop-all.sh: No such...

arokem