spark-avro
spark-avro copied to clipboard
Support xz codec
There is no way to directly read/load avro.xz files in Spark, can it be supported any time soon?
https://avro.apache.org/docs/1.7.7/api/java/org/apache/avro/file/XZCodec.html
Thanks!
Happy to accept PRs for this. Do you have any idea how hard this would be? Is it simply a matter of getting this library to not reject .xz files? Will avro-mapred handle the decompression automatically?