iceberg-go icon indicating copy to clipboard operation
iceberg-go copied to clipboard
verified publisher icon apache

Implementations?

Open delaneyj opened this issue 2 years ago • 3 comments

Question

Iceberg has subprojects targetting arrow/orc/parquet/etc. Is there plans to have adapters be part of this repo?

Are there plans to have interfaces for SchemaToDatastore?

delaneyj avatar Sep 08 '23 15:09 delaneyj

I plan on supporting Arrow, Parquet, Avro and Orc in this repo as much as I can.

That said, I'm not familiar with SchemaToDatastore, but I want to support as much as possible in this library.

zeroshade avatar Sep 08 '23 16:09 zeroshade

Oh its not a library, I meant include an interface to be able to plugin any of these options or others. Is there a timeline for Parquet?

delaneyj avatar Sep 08 '23 17:09 delaneyj

There isn't a timeline currently as I'm very limited by the bandwidth of available Iceberg committers with the time (and ability) to review the Go code and actually merge the commits. Though I have the majority of work through a working REST catalog that can read the metadata already sketched out. Actually fetching the data from parquet files would be next on the list after that.

zeroshade avatar Sep 19 '23 15:09 zeroshade