iceberg-python

iceberg-python copied to clipboard

Support `write.metadata.delete-after-commit.enabled` and `write.metadata.previous-versions-max` table properties and automatically delete old metadata files on commit Feature reference: https://iceberg.apache.org/docs/1.5.1/maintenance/#remove-old-metadata-files

sungwy

[feat] Table maintenance tasks

2

### Feature Request / Improvement https://iceberg.apache.org/docs/latest/maintenance/ Potentially dupe of #31 Recommended Maintenance - [ ] Expire Snapshots (https://github.com/apache/iceberg-python/issues/516) - [ ] #1199 - [ ] #1200 Optional Maintenance - [...

kevinjqliu

Bump pydantic from 2.9.1 to 2.9.2

1

Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.9.1 to 2.9.2. Release notes Sourced from pydantic's releases. v2.9.2 (2024-09-17) What's Changed Fixes Do not error when trying to evaluate annotations of private attributes by @​Viicos...

dependabot[bot]

Bumps [mmh3](https://github.com/hajimes/mmh3) from 4.1.0 to 5.0.1. Release notes Sourced from mmh3's releases. v5.0.1 What's Changed Fix issue with not building from sdist by @​hajimes in hajimes/mmh3#91 Full Changelog: https://github.com/hajimes/mmh3/compare/v5.0.0...v5.0.1 v5.0.0...

dependabot[bot]

NumPy Hardpin 1.26 issue

1

### Apache Iceberg version 0.7.1 (latest release) ### Please describe the bug 🐞 issue : In the latest version (0.7.1) , we notice that NumPy is hard-pinned at 1.26 (pyproject.toml...

anuraggautam14

Fast Avro Decoder not included in Conda Deployment of pyiceberg

7

### Feature Request / Improvement when you install pyiceberg via conda you get warnings like: /home/coder/.conda/envs/coder/lib/python3.10/site-packages/pyiceberg/avro/decoder.py:185: UserWarning: Falling back to pure Python Avro decoder, missing Cython implementation warnings.warn("Falling back to...

aschreiber1

Add integration tests with PostgreSQL DB backend

3

### Feature Request / Improvement PostgreSQL is a formally recognized DB backend for the [SQLCatalog](https://py.iceberg.apache.org/configuration/#sql-catalog), but we do not have any integration tests that make use of a postgresql connection...

sungwy

kevinjqliu

to_pandas(), to_arrow() fail because case_sensitive doesn't work if column in row_filter doesn't match the case even if case_sensitive is set to False in scan

5

### Apache Iceberg version 0.7.1 (latest release) ### Please describe the bug 🐞 I have a table with column business_time_hour (all lower case). If I capitalize one character, to_pandas() (and...

leonidmakarovsky

Make REST Catalog Namespace Separator Configurable

1

### Feature Request / Improvement Similar to the proposed changes in Java/ REST Catalog Open API Spec, we'd like to make the REST Catalog Namespace Separator Configurable address issued in...

sungwy