spark-avro icon indicating copy to clipboard operation
spark-avro copied to clipboard

Support xz codec

Open ktian opened this issue 9 years ago • 1 comments

There is no way to directly read/load avro.xz files in Spark, can it be supported any time soon?

https://avro.apache.org/docs/1.7.7/api/java/org/apache/avro/file/XZCodec.html

Thanks!

ktian avatar Oct 25 '16 15:10 ktian

Happy to accept PRs for this. Do you have any idea how hard this would be? Is it simply a matter of getting this library to not reject .xz files? Will avro-mapred handle the decompression automatically?

JoshRosen avatar Nov 23 '16 08:11 JoshRosen