filesystem_spec
filesystem_spec copied to clipboard
A specification that python filesystems should adhere to.
I noticed a difference in fsspec's handling of folders containing parquet files: Call method:` pd.read_parquet ("s3://xxx/test_dir/")` Normally, if there is a parquet file under the test_dir, this method can read...
We have an issue - https://github.com/dandi/dandi-cli/issues/1450 that one of our tests once in a while hangs (well, times out at 300 sec), but typically succeeds ok. the "fuller" traceback is...
implementation of #1651
This PR solves a use case I have where I want to use `filecache` or `simplecache` to assist me in downloading a file and using the local path. Further, I...
Hi, Saving a file via `fsspec.open()` results in default (macOS) permissions 644. Saving a file via `fs.transaction, fsopen()` strips group and guest permissions to 600. Is this intended? Here's a...
This PR introduces a new filesystem backend, `GistFileSystem`, which allows read-only access to files within a single GitHub Gist (as suggested in #888). I'd find this really useful in combination...
I am investigating [this issue](https://github.com/scikit-hep/uproot5/issues/1251) in uproot, where we try to open a file that contains ```::``` in the name of the file. As you can see, the expected behavior...
Hi fsspec developers, I realized when using a later version of fsspec than the ones from 2023 that the `.ls()` was super slow. The reason came in in this issue...