iceberg Support fan-out reads in PyIceberg

Support fan-out reads in PyIceberg

Open holdenk opened this issue 3 years ago • 1 comments

For the Python Iceberg implementation it would be good to support fanning out the reads of the manifest files & maybe other files too.

Jun 30 '21 18:06 holdenk

We could do this with Spark or Dask or Ray depending on what's installed on the system.

Jul 28 '21 17:07 holdenk

We could do this with Spark or Dask or Ray depending on what's installed on the system.

Perhaps consider Modin as well?

Dec 14 '22 22:12 ddrinka

Migrated this issue to the iceberg-python repository: https://github.com/apache/iceberg-python/issues/16

Oct 02 '23 07:10 Fokko