iceberg-python
iceberg-python copied to clipboard
apache
Apache PyIceberg
### Feature Request / Improvement Migrated from https://github.com/apache/iceberg/issues/7598: Hi, I've been looking at seeing what we can do to make PyArrow Datasets extensible for various table formats and making them...
### Question I keep getting this error ? `Failed to read from Iceberg file 'abfss://xxxxxx.dfs.core.windows.net/data/iceberg_dwh/scada/metadata/snap-2728627078701324745-0-7c1d442e-7321-46f8-aa06-5d5f94cde607.avro': Failed to open file: abfss://xxxxxx.dfs.core.windows.net/data/iceberg_dwh/scada/metadata/snap-2728627078701324745-0-7c1d442e-7321-46f8-aa06-5d5f94cde607.avro`
This is done through the Iceberg metadata, resulting in efficient deletes if the data is partitioned correctly
Created a decorator which when applied to a function performs commits, and retries the function on the table. It will look at the table properties and perform reties if the...
### Feature Request / Improvement In Iceberg Spark there are metadata tables that provide information around the table: https://iceberg.apache.org/docs/latest/spark-queries/ The most important tables are: - [ ] *Files* assigned to...
### Feature Request / Improvement Historical tags in iceberg docs - https://iceberg.apache.org/docs/1.5.0/branching/#historical-tags Not sure if it was intentional behavior, but pyiceberg `v0.6.0` allowed tagging by using public `set_ref_snapshot` method: ```py...
### Feature Request / Improvement Currently, [create_table API](https://github.com/apache/iceberg-python/blob/102e043b182a0b7bf4c9f66c5d77b24eedbd3766/pyiceberg/catalog/sql.py#L144) only supports defining partition fields and sort fields by using PartitionSpec and SortOrder respectively. [PartitionField](https://github.com/apache/iceberg-python/blob/102e043b182a0b7bf4c9f66c5d77b24eedbd3766/pyiceberg/partitioning.py#L45) and [SortField](https://github.com/apache/iceberg-python/blob/b7cf14e3b195064d8740b8f2ab306d8729e54dc2/pyiceberg/table/sorting.py#L69C7-L69C16) have the constraint that their...
### Apache Iceberg version 0.4.0 ### Please describe the bug 🐞 When trying to get a table containing a slash character in the name from the Iceberg REST catalog, pyiceberg...
Fixes #674 `Schema` and `StructType` `fields` variable is represented by `Tuple`, which means that ordering matters when performing comparison. Two `Schema`s with the same `fields` in different order should be...