iceberg-python

iceberg-python copied to clipboard

Support LocationProviders like the Java Iceberg Reference Implementaiton

1

### Feature Request / Improvement The Iceberg Java API supports customizing where data files are written using LocationProviders. By default, Iceberg writes data files following a Hive schema. However, table...

corleyma

Writing an arrow table with date64 unsupported

5

### Apache Iceberg version 0.6.0 (latest release) ### Please describe the bug 🐞 ``` TypeError: Unsupported type: date64[ms] ``` ``` from decimal import Decimal from pyiceberg.catalog.sql import SqlCatalog import pyarrow...

vtk9

Addresses #310 Consolidate FileIO TODO: * Figure out what to do about `HadoopFileSystem.from_uri(f"hdfs://{netloc}")` * Get rid of `parse_location` * Pushdown similar function to `io/__init__.py` as much as possible

kevinjqliu

### Feature Request / Improvement **Feature Request / Improvement** Support Metrics reporting like `ScanReport`, `CommitReport`, `RESTMetricsReporter` and custom metrics reporter. https://iceberg.apache.org/docs/nightly/metrics-reporting/

chinmay-bhat

ERROR: Could not build wheels for mmhash3, which is required to install pyproject.toml-based projects

1

### Apache Iceberg version 0.6.0 (latest release) ### Please describe the bug 🐞 During the installation of pyiceberg, I always get this error: Building wheels for collected packages: mmhash3 Building...

makssyz

### Apache Iceberg version 0.6.0 (latest release) ### Please describe the bug 🐞 There might be other combinations that don't work **Note**: works with (when replaced with line in reproducer)...

vtk9

Add support for orc format

5

- [x] Ability to read orc file format based Iceberg Table - [ ] Ability to create orc file format based Iceberg Table - [ ] Unit Test - [x]...

MehulBatra

PR in Progress, **not ready for review** Create Cherry pick and Publish changes APIs and classes. PR depends on unmerged changes in other PRs - _deleted_data_files for _MergingSnapshotProducer from the...

chinmay-bhat

Support IsolationLevels and Concurrency Safety Validation Checks

11

### Feature Request / Improvement Support enforcing Isolation Levels from specified snapshot ID https://iceberg.apache.org/docs/latest/spark-configuration/#write-options There's been a lot of continued interest in using multiple PyIceberg applications concurrently and having proper...

sungwy

BUG: Bug: partition name stored in partition data in data file contains special character

2

### Apache Iceberg version 0.5.0 (latest release) ### Please describe the bug 🐞 an example to demonstrate the issue https://github.com/puchengy/iceberg-python/commit/6bd4cefe74aae64317d34739545a7929ecbedd82 Due to ```failed to solve: executor failed running [/bin/sh -c...

puchengy