spark-ec2 icon indicating copy to clipboard operation
spark-ec2 copied to clipboard

Published 20 hours ago • verified publisher icon amplab

Hadoop 2.6 support for Spark 1.6

Open anfeng opened this issue 8 years ago • 4 comments

Is there any reason that you only support Hadoop 2.4 for Spark 1.6? It will be lovely if you could also support Hadoop 2.6.

anfeng avatar Feb 09 '17 22:02 anfeng

Actually, I've made some dirty hacks here https://github.com/grammarly/spark-ec2 for my own use. Not so complex and it works, in my case. I needed in s3a support that was included to hadoop 2.6.

WIgor avatar Feb 22 '17 10:02 WIgor

@wigor would you be interested in sending a PR for this ?

shivaram avatar Feb 22 '17 20:02 shivaram

@shivaram Yes, I thought to update this to latest spark version. And then will send PR.

WIgor avatar Feb 22 '17 20:02 WIgor

propose a PR #88

anfeng avatar Feb 22 '17 21:02 anfeng