iceberg-python

iceberg-python copied to clipboard

Add `MergeAppendFiles`. This PR will enable the following configurations: - `commit.manifest-merge.enabled`: Controls whether to automatically merge manifests on writes. - `commit.manifest.min-count-to-merge`: Minimum number of manifests to accumulate before merging. -...

HonahX

How to load a table with bucket partition

5

### Question The table DDL is ``` create table test1 ( id int, data int ) using iceberg partitioned by (bucket(4, id)); ``` How to write the row_filter to load...

frankliee

Exclude Python 3.9.7 due to import error in catalog module

1

Adjusts the supported Python versions to exclude 3.9.7, as importing the catalog module on this version results in an unexpected error. The issue does not occur in versions 3.9.6 or...

ndrluis

"partition-spec" and "schema" are deprecated but required field in v1 table metadata. For backward compatibility, I think we should to update "partition-spec" when applying `SetDefaultSpecUpdate` and "schema" when applying `SetCurrentSchemaUpdate`.

HonahX

[feat request] Make `Table` / `TableMetadata` JSON serializable

3

### Feature Request / Improvement The REST Catalog exposes `Table` and `TableMetadata` information as HTTP endpoints in JSON format ([link](https://iceberg-rest-image.fly.dev/v1/namespaces/default/tables/taxi_dataset)). This information is similar to the internal state of `Table`...

kevinjqliu

Ability to pickle the `Catalog`

7

### Feature Request / Improvement This allows distribution of the Catalog object within Ray.

Fokko

Add ability to pickle a `Table`

3

### Feature Request / Improvement This allows distribution of the Table object within Ray.

Fokko

Glue endpoint config variable

2

Closes: https://github.com/apache/iceberg-python/issues/414 I don't know java, but tried to stay true to [the implementation](https://github.com/apache/iceberg/blob/053d54172fd903be9eda78957f3cbd3aadef1f7b/aws/src/main/java/org/apache/iceberg/aws/AwsProperties.java#L97-L103), at least in regards to the commenting. Open Questions: 1. I did a very basic test,...

sebpretzer

Support Nessie catalog

5

### Feature Request / Improvement PyIceberg has added support for glue catalog. We need to have support for Nessie catalog too just like hive, glue, REST catalogs. Migrated from https://github.com/apache/iceberg/issues/6414

Fokko

Set table properties through Hive

1

### Feature Request / Improvement Allow setting table properties through Hive

Fokko