apache
Tracking issues of PyIceberg 0.11 release
Feature Request / Improvement
Targeting around end of Nov / beginning of Dec
Would like to get all the open catalog PR's merged in if possible!!!!
A lot of view stuff is open, rest stuff, ideally also supporting pagination/laziness changes in favor of materializing results in at least the list* methods in catalog as well as in the inspect methods!
+1 on views and catalog, also some important bug fixes (small plug) that we have been getting internally would be cool (PR, PR, PR) and also the Delete File Index PR so we can unblock progress on commit retries
Metadata Compaction and Data File Compaction are top of mind for me - and not to mention this and this 😄
Would be great to get a fix for this - cant just add a column to a table and continue inserting data: https://github.com/apache/iceberg-python/issues/2467
Currently need to drop the entire table, recreate table with new column and then ingest again.
0.10.0 regression preventing us from using S3 remote signing with a catalog accessed using OAuth - https://github.com/apache/iceberg-python/issues/2544
I''ll +1 on views + rest work, since I've got PRs out for many of those!
Incremental append scans to kick off incremental reads would be great! https://github.com/apache/iceberg-python/issues/2634
I'm not sure if there's something more fundamental preventing this as it's been open for a while but it'd be awesome to be able to write data to tables that respects sort orders. It looks like there was a PR made for this that got delayed while transforms were being implemented in the rust extension, so it's possible that there isn't a ton more work to do for this.
Similarly being able to leverage sort order to optimize reads would be awesome - https://github.com/apache/iceberg-python/issues/1637
Would like to get these two in as well: https://github.com/apache/iceberg-python/pull/1661, https://github.com/apache/iceberg-python/pull/1958
It would also be awesome to get commit retries merged in (#330) - it's a pain to have to manage commit retries manually everywhere.