iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

[feat] push down schema casting to the record batch level

Open kevinjqliu opened this issue 6 months ago • 0 comments

Feature Request / Improvement

https://github.com/apache/iceberg-python/blob/f05b1aedee8451d981188adf68be5e8b360a9ca1/pyiceberg/io/pyarrow.py#L1225-L1231

Related to #929

Requires Arrow 17 (possibly 18?)

  • https://github.com/apache/arrow/issues/41884 is in Arrow 17
  • https://github.com/apache/arrow/issues/43183 is in Arrow 18

kevinjqliu avatar Aug 13 '24 05:08 kevinjqliu