explorer
explorer copied to clipboard
Reading "partitioned data"
Hey all,
I'm looking into using this project, and I don't know that there is an API for reading "partitioned data" as defined in the Apache Arrow documentation (source: https://arrow.apache.org/docs/python/dataset.html#reading-partitioned-data).
Both the python and nodejs libraries appear to implement this pattern.
Interesting. I don't think we have this feature in Explorer today, but could be a nice one to have in the future :)
I notice that Polars doesn't have it either, so maybe it's a good idea to implement there first. They have two issues for that: https://github.com/pola-rs/polars/issues/2257 and https://github.com/pola-rs/polars/issues/426