iceberg-python

iceberg-python copied to clipboard

Incremental Append Scan

6

Hi，@Fokko， long time no see. 😄 I have written some preliminary code for incremental reading, but it still needs a lot of work. However, I would like to discuss it...

hililiwei

Support for REPLACE TABLE operation

8

Closes #281 API proposal (from PR feedback): ``` table = catalog.create_or_replace_table(identifier, schema, location, partition_spec, sort_order, properties) ``` TODO: - [ ] Update schema - [ ] Update partition spec -...

anupam-saini

### Feature Request / Improvement Feature request to add support for loading and interacting with catalogs from BigLake Metastore. Reference: [GCP: Add Iceberg Catalog for GCP BigLake Metastore #7412](https://github.com/apache/iceberg/pull/7412)

sashkaw

Integration tests performance degradation

6

### Apache Iceberg version main (development) ### Please describe the bug 🐞 Integration tests feel significantly slower than before. ``` make test-integration ``` Running on the latest main branch took...

kevinjqliu

Kevinjqliu/poc parallelize tests

1

I don't think this works until each test can run in isolation

kevinjqliu

ORC file format support

6

### Feature Request / Improvement Migrated from https://github.com/apache/iceberg/issues/6973

Fokko

### Feature Request / Improvement I got PyIceberg working connecting to a SQL catalog (Postgres JDBC) and connecting to an ADLFS account using the `account-name` and `account-key` configuration settings. However...

cccs-jory

Resolve dependency errors found by `deptry` (added in #528). From 27 -> 16 errors * Add `botocore` to main dependency (4 errors) * Move `typing_extensions` from dev dependency to main...

kevinjqliu

Create iceberg table from existsing parquet files with slightly different schemas (schemas merge is possible).

7

### Question Hi! What is a right way to create an iceberg table from existsing parquet files with slightly different schemas? So merge of their schemas is possible. I would...

sergun

Implement rolling manifest-writers

3

### Feature Request / Improvement Once we get support for merge-append https://github.com/apache/iceberg-python/pull/363 operations, and also compaction in the future, it would be good to have rolling-manifest writers that open a...

Fokko