training

training copied to clipboard

This directory is already included in the zip file that the users download; as such, the Spark job to generate the dir fails with o.a.h.fs.FileAlreadyExistsException

kimballa

With unreliable internet, the 'localhost:8080/freq' and 'localhost:8080/reads' pages in the ADAM web app will not render correctly because they rely on 3rd party js and/or css which should be localized.

kimballa

SparkStreaming in ampcamp4 is not working.

6

I followed instruction in ampcamp4 and launched amazon ec2 instances. I tried to run Spark Streaming but it was not working. I suffered from the problem that scala version mismatch...

giwa

I couldn't find any links to the wiki dataset used so I downloaded them from wikimedia. When I run the pagerank I get weird page titles though, so midway the...

havnar

problem launching bdas cluster

3

I followed the instructions here for launching a BDAS cluster: http://ampcamp.berkeley.edu/3/exercises/launching-a-bdas-cluster-on-ec2.html Everything seemingly goes ok. When I try to list the files on hdfs I get the following errors and...

dqingram

update path from /root/spark/sbin/ to /root/spark/bin

2

The path to various bash scrips seems to be incorrect in both spark-ec2.py and /root/spark-ec2/spark-standalone/setup.sh. It's easy to fix the first one; not sure about the second.

M1chaelM

spark shell connection problem

1

Hello Everytime I want to start the spark shell I get this error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/repl/Main Caused by: java.lang.ClassNotFoundException: org.apache.spark.repl.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190)...

AlexanderRiggers

spark-ec2 script failed to "mkdir -p ~/.ssh"

3

I don't know why this didn't work on my MacBook Pro, but I suspect I was prompted to allow the ip address to be added to my known-hosts file, but...

deanwampler

Data samples URL?

8

Hi, I am interested in completing the tutorials, although I'm not at an Ampcamp (so I don't have access to the AMIs you're using there). Is there anywhere I can...

futurechimp

Modify script to launch inside a VPC

1

Hi guys Can u modify or please provide guidance how to modify the script to launch cluster in a VPC . Or alternately please provide a way to make this...

sanjaysubramanian