explorer icon indicating copy to clipboard operation
explorer copied to clipboard

Reading "partitioned data"

Open isaacsanders opened this issue 3 years ago • 1 comments

Hey all,

I'm looking into using this project, and I don't know that there is an API for reading "partitioned data" as defined in the Apache Arrow documentation (source: https://arrow.apache.org/docs/python/dataset.html#reading-partitioned-data).

Both the python and nodejs libraries appear to implement this pattern.

isaacsanders avatar Mar 11 '22 18:03 isaacsanders

Interesting. I don't think we have this feature in Explorer today, but could be a nice one to have in the future :)

I notice that Polars doesn't have it either, so maybe it's a good idea to implement there first. They have two issues for that: https://github.com/pola-rs/polars/issues/2257 and https://github.com/pola-rs/polars/issues/426

philss avatar Mar 16 '22 01:03 philss