training icon indicating copy to clipboard operation
training copied to clipboard

update path from /root/spark/sbin/ to /root/spark/bin

Open M1chaelM opened this issue 10 years ago • 2 comments

The path to various bash scrips seems to be incorrect in both spark-ec2.py and /root/spark-ec2/spark-standalone/setup.sh. It's easy to fix the first one; not sure about the second.

M1chaelM avatar Sep 01 '14 07:09 M1chaelM

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.

JoshRosen avatar Sep 01 '14 20:09 JoshRosen

That sounds likely. :) I believe I’m following the directions for ampcamp4. The instructions for using us-west-1 give ami-6ac4ee2f (see http://ampcamp.berkeley.edu/big-data-mini-course/launching-a-bdas-cluster-on-ec2.html under "Can I use a EC2 region other than us-east-1 while creating the cluster?”)

I created a key-pair for the east region and rerunning the launch command shows that the most recent ami is ami-19474270. This seems to be working now.

Thank you!

On Sep 1, 2014, at 1:32 PM, Josh Rosen [email protected] wrote:

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.

— Reply to this email directly or view it on GitHub.

M1chaelM avatar Sep 01 '14 21:09 M1chaelM