iceberg-python
iceberg-python copied to clipboard
apache
Apache PyIceberg
### Feature Request / Improvement ### **Summary** Currently, PyIceberg only loads storage credentials from the `config` section of the table response. Meanwhile, Java Iceberg has added support for *vended credentials*...
### Feature Request / Improvement Add merge strategies commonly used in version control systems to pyiceberg. Motivated by some of the discussion found here https://github.com/apache/iceberg-python/issues/2428: 1. **MERGE**: creating a merge...
# Rationale for this change As part of #818, this adds `rename_view` support to the Iceberg REST Catalog. The [REST Catalog spec](https://editor-next.swagger.io/?url=https://raw.githubusercontent.com/apache/iceberg/main/open-api/rest-catalog-open-api.yaml) specifies that both `rename_view` and `rename_table` do not...
# Rationale for this change This allows date->time promotion on v3 tables only. It also adds a bunch of plumbing to ensure this only works on v3. Relates to https://github.com/apache/iceberg/pull/14266...
### Apache Iceberg version 0.9.1 ### Please describe the bug 🐞 When printing or using repr() on a PyIceberg DataFile object, it displays as an empty DataFile[] instead of showing...
# Rationale for this change Iceberg V3 supports both Geography & Geometry types. # Are these changes tested? Not enough
Closes #2302 # Rationale for this change This adds the models for server-side planning. There's a lot of model-related code (the requests + responses are large!), so I'm just adding...
Closes #2325 # Rationale for this change Fixes the memory leak in the manifest cache ## Are these changes tested? Yes ## Are there any user-facing changes? No
### Feature Request / Improvement ## Feature Request / Improvement Upserting large dataframes (tens of millions of rows) in un-usably slow due to creating a massive `BooleanExpression` in `upsert_util.create_match_filter`. This...
# Rationale for this change Add `make notebook` to spin up a jupyter notebook With spark connect (#2491) and our testing setup, we can quickly spin up a local env...
