Fokko Driesprong

This makes it easier to track where the tables come from.

Ignore partition fields that are dropped from the current-schema

2

A second attempt to fix this (the first attempt in https://github.com/apache/iceberg/pull/11604 but that one was not safe). When a field that's dropped that still part of an older partition spec,...

Spark: Support Parquet dictionary encoded UUIDs

2

While fixing some issues on the PyIceberg ends to fully support UUIDs: https://github.com/apache/iceberg-python/pull/2007 I noticed this issue, and was suprised since UUID used to work with Spark, but it turns...

See `DISCUSS` on dev-list: https://lists.apache.org/thread/c91s61tqkbbrc7xj180xh2rx89yx8pfk ### Rationale for this change ### What changes are included in this PR? ### Are these changes tested? ### Are there any user-facing changes?

feat: Don't drop additional statistics

1

This is a behavioral change. In Iceberg-Rust we require upper/lower bounds to be part of the schema. But in some cases, this in't the case, most obvious schema evolution. In...

Update a TableSchema from a Schema

3

To make things easier for query engines to evolve schemas into a target schema, it would be great to add `UnionByName` to Iceberg-Rust as well. The `UnionByName` visitor ([python](https://github.com/apache/iceberg-python/blob/2ba86b5c852cb0c8f4b4ba95d54fb5a6bfa00fa2/pyiceberg/table/update/schema.py#L722), [java](https://github.com/apache/iceberg/blob/daa24f9c3a56e18d188097deb2dd79cc991c9a78/core/src/main/java/org/apache/iceberg/schema/UnionByNameVisitor.java#L33))...

Make the integration tests work on Docker desktop

5

When I run `make test`, all the docker-based tests fail because the `172.*` does not resolve. I think this is the difference between OSX and Linux when it comes to...

Use Iceberg-Rust for parsing the ManifestList and Manifests

7

# Rationale for this change This replaces the Cython implementation for reading Avro with Iceberg-Rust. This would greatly simplify the PyIceberg project since we don't have to publish Python wheels...

Make `and` expression JSON serializable

6

### Feature Request / Improvement Make sure that the `and` expression can be serialized to JSON: https://github.com/apache/iceberg-python/blob/e5e74534a4938fcace2c782a237474b7e94da68c/pyiceberg/expressions/__init__.py#L250 This should follow: ```json { "type": "and", "left": BooleanExpression, "right": BooleanExpression } ```...

Make `UnaryPredicate` predicate JSON serializable

1

### Feature Request / Improvement Make sure that the `UnaryPredicate` predicate can be serialized to JSON: https://github.com/apache/iceberg-python/blob/e5e74534a4938fcace2c782a237474b7e94da68c/pyiceberg/expressions/__init__.py#L432-L443 This predicate has four implementations: `IsNull`, `NotNull`, `IsNaN`, and `NotNan`, and translates to:...