Shivaram Venkataraman

Yeah its awkward that Apache / Amazon wouldn't have a fast way to download Hadoop on EC2. I'm talking to @pwendell and @JoshRosen to see if we can add Hadoop...

Thanks to @JoshRosen I now have permission to upload to the spark-related-packages bucket. Right now Hadoop 2.6 and Hadoop 2.7 tar.gz files should be up there. @jamborta Could you test...

I would like to keep this one off and not make it "official" as I dont think we have enough resources to track all Hadoop releases and keep this up...

Short of recreating the AMIs there might not be an out of the box way to do this. However we can just install OpenJDK 8 using something like `yum install...

It looks like there are some conflicts - Could you resolve them ?

@nchammas Thats a reasonable question - I uploaded 2.7.0 as @jamborta had used that in the PR. On the one hand I dont mind starting off with 2.7.3 right now...

@jamborta 2.7.3 and 2.6.5 are now in the same S3 bucket

Thanks @felixmaximilian for the report. The trouble is that increasing EBS volume size requires AMIs to be rebuilt for all the regions. One workaround might be to build Spark on...

Yeah just to clear some things - AFAIK to increase root partition size needs an AMI rebuild. However I think we should be able to clone and build Spark on...

Could you explain the motivation for this change ?