Julien Le Dem
Julien Le Dem
@subahugu only old versions of hive use parquet-hive. since hive 0.13 the parquet serde is in hive. This code is to be deleted. Do you need a parquet 1.7.1 release?
@subahugu thanks. If this is not needed anymore please close this PR.
@nongli Does this look related to what you were doing in Spark SQL?
@isnotinvain Since you worked on the initial predicate push down. Did you have an opinion?
@rdblue updated
@rdblue I have updated the spec per your comments.
Where do we want to document this? I'd separate what is defined by the format and what is specific to each model integration. To me it sounds like we'd want...
I rebased and addressed @rdblue latest feedback before the union projection discussion. I'm planning to add the details I mention in https://github.com/apache/parquet-format/pull/44#issuecomment-258503184 pending feedback from @rdblue and @isnotinvain .
@rdblue Agreed except for the last bit: "Parquet won't project a subset of the branches unless the union group is optional" I don't think it should. Users should be able...
@rdblue but this constraint can be defined in avro and thrift. Just not as a global rule.