cluster-pack
cluster-pack copied to clipboard
use fsspec instead of custom generic filesystem
https://github.com/criteo/cluster-pack/blob/master/cluster_pack/filesystem.py
+1 on this. It should be possible now with arrow 6.0.0:
- https://issues.apache.org/jira/browse/ARROW-7102
- https://issues.apache.org/jira/browse/ARROW-8780
Do you want to try to submit a PR ?