filesystem_spec
filesystem_spec copied to clipboard
fsspec
A specification that python filesystems should adhere to.
I have a use case for the following APIs, and wanted to get opinions on whether they are feasible as additions: Firstly, ```py def get_protocols(url: str) -> tuple[str, ...]: """Returns...
Currently `fsspec.core.OpenFile` objects have a property called `full_name` which I think should return the full file name i.e. the protocol + local path. I think it would be nice that...
Trying to use the `blockcache` filesystem with a `local` filesystem as a target raises an error if you try to close a file manually. Here's a reproduction: ```python from tempfile...
Note, this issue could also be caused by `xarray`. I have [kerchunked](https://fsspec.github.io/kerchunk/reference.html#kerchunk.hdf.SingleHdf5ToZarr) a large number of NetCDF4 files (located in S3) and put the reference JSONs into a single Zip...
`fsspec.implementations.zip.ZipFileSystem` seems to have an issue with append mode 'a'. I assume, opening in mode 'a' allows for adding new Zip-entries to an existing Zip archive. At least this is...
### Description When trying to truncate a file while using local storage, an error is raised even if the provided `mode` is correct. This may be due to the missing...
I'm trying to learn more about how fsspec works (so I can better understand the IO part of the Pangeo stack), but I'm confused by the structure of `fsspec/filesystem_spec`. Despite...
Hey, I'm trying to read files from a GitHub LFS Repo (https://github.com/openai/dalle3-eval-samples/tree/main) but only get the pointers to the actual large files (the images in the repo), instead of the...
DirFileSystem can wrap any async filesystem. But cause `open_async` method is not redirected to wrapped fs, it will always raise `NotImplementedError`. As mentioned in #1411, cause all unimplemented methods in...
The ABOR command is sent when the ftp file download is finished, the server no longer responds and raises the TimeoutError code: ```python def test1(): fs: FTPFileSystem = fsspec.filesystem('ftp', asynchronous=True,...
