spark-compaction
spark-compaction copied to clipboard
S3 support
A common approach of implementing Spark has become utilizing AWS EMR and using S3 for file storage in lieu of HDFS. Please implement S3 support for implementing a compaction algorithm.