iceberg-python

iceberg-python copied to clipboard

Regression in 0.7.0 due to type coercion from "string" to "large_string"

5

### Apache Iceberg version 0.7.0 ### Please describe the bug 🐞 There is a regression in introduced in version 0.7.0 where arrow tables written with a "string" data type, get...

maxfirman

CLI list not working

7

### Apache Iceberg version 0.7.1 (latest release) ### Please describe the bug 🐞 I am currently trying out the pyiceberg CLI, and found this command seems not working as expected:...

TiansuYu

### Feature Request / Improvement The ability to refresh AWS credentials is important for long-running jobs. Also see #1104

kevinjqliu

Concurrent writes failures

4

### Apache Iceberg version 0.7.1 ### Please describe the bug 🐞 ## Summary I'm currently trying to migrate a couple of dataframes with a custom hive-like storage scheme to Iceberg....

bikeshedder

Try `arro3` as custom FileIO in tests

1

### Feature Request / Improvement https://github.com/kylebarron/arro3 "A minimal Python library for Apache Arrow, connecting to the Rust arrow crate" Set `py-io-impl` and run tests Good litmus test to check how...

kevinjqliu

### Feature Request / Improvement Pre-req: Arrow 17 (#929) #### Details `pyarrow.dataset.Scanner.from_fragment`'s `filter` parameter now takes an `Expression` type in Arrow 17. https://arrow.apache.org/docs/python/generated/pyarrow.dataset.Scanner.html#pyarrow.dataset.Scanner.from_fragment We can try to push down both...

kevinjqliu

### Feature Request / Improvement https://github.com/apache/iceberg-python/blob/f05b1aedee8451d981188adf68be5e8b360a9ca1/pyiceberg/io/pyarrow.py#L1225-L1231 Related to #929 Requires Arrow 17 (possibly 18?) * https://github.com/apache/arrow/issues/41884 is in Arrow 17 * https://github.com/apache/arrow/issues/43183 is in Arrow 18

kevinjqliu

### Apache Iceberg version main (development) ### Please describe the bug 🐞 Notebook to repro https://gist.github.com/kevinjqliu/e3f454d829d8711ecf9909e11a20add6 Expectation: First, the table is partitioned by the `timestamp ` field. After evolving the...

kevinjqliu

PyIceberg is not respecting `token` in the load table response

2

### Apache Iceberg version 0.7.1 (latest release) ### Please describe the bug 🐞 In the Iceberg REST API spec, the load table endpoint can include a `config` map with additional...

creechy

TypeError when `operation` field is missing in `summary`.

4

### Apache Iceberg version 0.6.0 ### Please describe the bug 🐞 When attempting to read the metadata.json file, which contains a list of snapshots where some snapshot summaries lack the...

questsul