parquet-java icon indicating copy to clipboard operation
parquet-java copied to clipboard
verified publisher icon apache

Column resolution by ID

Open asfimport opened this issue 4 years ago • 1 comments

Parquet relies on the name. In a lot of usages e.g. schema resolution, this would be a problem. Iceberg uses ID and stored Id/name mappings.

This Jira is to add column ID resolution support.

Reporter: Xinli Shang / @shangxinli Assignee: Xinli Shang / @shangxinli

PRs and other links:

Note: This issue was originally created as PARQUET-2006. Please see the migration documentation for further details.

asfimport avatar Mar 23 '21 15:03 asfimport

Kevin Wen: any progress on this? it seems without this, we only get half optimization of parquet. Really appreciate the hard work has been done so far. Will this be moved forward anytime soon? 

asfimport avatar Sep 26 '22 19:09 asfimport