iceberg-python

iceberg-python copied to clipboard

int64() is converted to float for nullable field when None is provided + nan returned when None is expected

2

### Apache Iceberg version 0.6.0 (latest release) ### Please describe the bug 🐞 For reproduction using https://github.com/apache/iceberg-python/blob/main/tests/catalog/test_glue.py Here is failing test ```python @mock_aws def test_create_table_with_pyarrow_schema( _bucket_initialize: None, moto_endpoint_url: str, database_name:...

Co0olCat

### Feature Request / Improvement Today we only support full deletes (overwrite). Supporting partial deletes can be achieved at several places in Iceberg: - Pure delete operations: - Deleting a...

Fokko

Pyiceberg support the query without provided snapshot_id

1

### Feature Request / Improvement I would like to time travel query Icerberg table without knowing snapshot_id

dhruvils414

Support setting a snapshot property in same commit as spark.sql

17

### Feature Request / Improvement This [cookbook](https://tabular.io/apache-iceberg-cookbook/data-engineering-incremental-processing/) has a java snippet to update a snapshot property atomically with a sql MERGE INTO. ```java // Update the target table and set...

brianfromoregon

Build: Bump pytest from 7.4.4 to 8.0.0

3

Alternative for #319 `pytest-lazy-fixture` is not compatible with pytest v8, and it looks like it will be never compatible as the project is not active anymore, there is a discussion...

hussein-awala

Support Table Migration features from Spark

2

### Feature Request / Improvement https://iceberg.apache.org/docs/latest/spark-procedures/#table-migration A lot of these are just metadata operations. Inspired by #346

kevinjqliu

Support writing to a table with sort-order

9

### Feature Request / Improvement We fail when we see a sort order, it would be great if we could sort+write the data based on the sort-order.

Fokko

Catalog table-default and table-override properties

1

### Feature Request / Improvement In the java code base, catalog configuration includes catalog table-default and table-override properties: Catalog Property Key | Description -- | -- spark.sql.catalog.catalog-name.table-default.propertyKey | Default Iceberg...

sungwy

Python: Add support for Python 3.12

9

reopen the PR: [Python: Add support for Python 3.12](https://github.com/apache/iceberg/pull/8531)

steinsgateted

REPLACE TABLE Support

12

### Feature Request / Improvement SparkCatalog supports "REPLACE TABLE ... AS SELECT" as an atomic operation when using a SparkCatalog. Similarly, we should introduce support for an atomic RTAS operation...

sungwy