Tamas Jambor

Results 15 comments of Tamas Jambor

I ported this to tf2, check it out here: https://github.com/jamborta/tffm2

added hadoop 2.7 as it has much better s3 support

@shivaram would be good to add hadoop2.6 and hadoop2.7 to your spark-related-packages s3 bucket as pulling it from www.apache.org gets slow from time to time.

@shivaram updated the code to handle the 4 distinct range of spark versions.

@shivaram would also be good to include hadoop-2.7.0 and hadoop-2.6.0 in your s3 bucket. it takes about 10 mins to pull that from apache.org (and needs to be done twice).

@shivaram updated the s3 path in the code. all works fine.

@shivaram updated the code based on your comments. `validate_spark_hadoop_version` in python should capture all the checks that are needed - but still kept the same logic spark/init.sh. i think some...

I agree that we could put the latest maintenance release for 2.4, 2.6 and 2.7 as it is now, and stick with those.

@shivaram if you upload the latest releases I can update this PR.