camel-kafka-connector icon indicating copy to clipboard operation
camel-kafka-connector copied to clipboard

Support Parquet input file formats using HDFS connector

Open matt12eagles opened this issue 4 years ago • 2 comments

Support Parquet input file formats using HDFS connector. Parquet is widely used in the HDFS world, would be awesome to be able to use parquet with the standard compressions (snappy, gzip, none) for this connector. I dont think a great open source HDFS source that supports parquet and kerberos exists, so it would be big for the kafka community.

matt12eagles avatar Jan 08 '21 13:01 matt12eagles

This needs to be done at camel component level

oscerd avatar Jan 08 '21 13:01 oscerd

Maybe related issue on Camel, for future reference: https://issues.apache.org/jira/browse/CAMEL-13573

orpiske avatar Jan 08 '21 13:01 orpiske