iceberg-python

iceberg-python copied to clipboard

Closes #2147 - Implement ResidualEvaluatorCache with LRU eviction and thread safety - Cache evaluators by partition spec, expression, case sensitivity, and schema # Rationale for this change For queries, the...

ForeverAngry

Can't use any catalog action related to S3 (create_table, load_table...)

2

### Apache Iceberg version 0.8.1 (latest release) ### Please describe the bug 🐞 ### Issue Summary We are experiencing a critical issue with **PyIceberg** that has suddenly emerged. Previously, we...

harelo-cf

Tracking issues of PyIceberg 0.11 release

10

### Feature Request / Improvement Targeting around end of Nov / beginning of Dec

kevinjqliu

# Rationale for this change This pull request introduces a Trino service to the Docker Compose development environment, addressing the need for broader integration testing capabilities as discussed in issue...

dingo4dev

Remove deprecated lazy_fixture dependency

4

### Feature Request / Improvement We heavy relay on `pytest-lazy-fixture` for the project: Unfortunately lazy-fixture hasn't been maintained (not a commit to the project over the last 3 years) and...

raulcd

make install tries to install uv even when uv is present

1

### Apache Iceberg version None ### Please describe the bug 🐞 When trying to set up the iceberg-python environment following the [contribution guidelines](https://github.com/apache/iceberg-python/blob/main/mkdocs/docs/contributing.md#getting-started) if I run `make install` it tries...

raulcd

fix: redirect only error output from makefile command to do not install uv if already present on system

2

Closes #2741 # Rationale for this change `make install` is currently trying to install `uv` even when is present locally: ```bash $ make install uv not found. Installing... /home/raulcd/.local/bin/uv ^Cmake:...

raulcd

# Rationale for this change This PR introduces support for multi-part namespaces, enabling more flexible and organized data layouts. This feature allows users to structure their tables within nested hierarchies...

dingo4dev

code cleanliness: burn down ruff ignore list

1

### Feature Request / Improvement Remove ignored linter rules https://github.com/apache/iceberg-python/blob/9e16bc220b225da8b8c9a2effc5046b6d8619607/ruff.toml#L60 - [ ] "E501" https://docs.astral.sh/ruff/rules/line-too-long/ - [x] "E203" https://docs.astral.sh/ruff/rules/whitespace-before-punctuation/ - [x] "B024" https://docs.astral.sh/ruff/rules/abstract-base-class-without-abstract-method/ - [x] "B028" https://docs.astral.sh/ruff/rules/no-explicit-stacklevel/ - [x] "UP037"...

kevinjqliu

Use Iceberg-Rust for parsing the ManifestList and Manifests

7

# Rationale for this change This replaces the Cython implementation for reading Avro with Iceberg-Rust. This would greatly simplify the PyIceberg project since we don't have to publish Python wheels...

Fokko