training
training copied to clipboard
update path from /root/spark/sbin/ to /root/spark/bin
The path to various bash scrips seems to be incorrect in both spark-ec2.py and /root/spark-ec2/spark-standalone/setup.sh. It's easy to fix the first one; not sure about the second.
Hi @M1chaelM,
Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.
That sounds likely. :) I believe I’m following the directions for ampcamp4. The instructions for using us-west-1 give ami-6ac4ee2f (see http://ampcamp.berkeley.edu/big-data-mini-course/launching-a-bdas-cluster-on-ec2.html under "Can I use a EC2 region other than us-east-1 while creating the cluster?”)
I created a key-pair for the east region and rerunning the launch command shows that the most recent ami is ami-19474270. This seems to be working now.
Thank you!
On Sep 1, 2014, at 1:32 PM, Josh Rosen [email protected] wrote:
Hi @M1chaelM,
Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.
— Reply to this email directly or view it on GitHub.