parquet-java icon indicating copy to clipboard operation
parquet-java copied to clipboard

Published 20 hours ago • verified publisher icon apache

PARQUET-198: Support for Parquet-Avro files from Cascading & Scalding [ --hdfs , --local and test mode ]

Open Antwnis opened this issue 10 years ago • 4 comments

Parquet-Avro file support for Cascading and Scalding. Supports filter predicates and projection push-downs

Parquet-Thrift support already exists. This pull requests covers the need for Parquet-Avro

Antwnis avatar Feb 22 '15 21:02 Antwnis

Just mentioning that is pull request is to track the progress on this ticket. So far a ParquetAvroScheme has been submitted and some additional dependencies have been added. Local mode will be added in this ticket in the near future.

Antwnis avatar Mar 04 '15 20:03 Antwnis

Hi @Antwnis , are you still interested in merging this in? Unaware of your PR and trying to tackle the same I made a PR myself. Please have a look at: https://github.com/apache/parquet-mr/pull/151 Would be great to get AvroParquet into Cascading/Scalding and I am happy to work together on this.

AndreSchumacher avatar Apr 23 '15 08:04 AndreSchumacher

Hi @AndreSchumacher

Still highly interested into proceeding with cascading Parquet/Avro PR - was waiting for the release to go ahead and graduation to be completed before proceeding. Happy to work together on this one !

Get me on skype - antonios.chalkiopoulos

Antwnis avatar Apr 23 '15 08:04 Antwnis

Is there any update with this item? Has the support for Parquet-Avro been added?

nitin02 avatar Nov 12 '16 05:11 nitin02