filesystem_spec
filesystem_spec copied to clipboard
fsspec
A specification that python filesystems should adhere to.
As identified in discussion of PR #1128, `maxdepth` kwarg that is used in `walk` and related functions can be improved in two ways: - Raise as an error if `maxdepth...
Tries to address #1126.
When calling `fs.put()` to upload a local directory to a remote filesystem, if the remote directory does not exist then only the local directory contents will be uploaded. However, if...
Currently it is possible to provide overrides with environment variables of the style `FSSPEC_{protocol}_{kwargname}=value`. However, this is limited since it is not possible to provide a dict value. One example...
Are you interested in type annotations? E.g. if I submitted a pull adding a bunch of type annotations to the project, is that something that you'd see being easily merged?
## fsspec fails trying to create a bucket when writing to S3 when folder/prefix doesn't exists ### Problem By default when writing with fsspec to remote filesystems `fsspec` sets the...
Let's say we have a file system called `bfs://` which is an equivalent implementation of HDFS. We can support pyarrow operation like following way. ``` import pyarrow as pa from...
My use case: I'm using the following snippet to create a virtual filesystem, and create an OpenFile handle. Important to me is that I have a common base class/interface (OpenFile)...
Hello, I'm running into a bug where I am unable to write NETCDF files to permissioned storage on Open Storage Network without having to explicitly create a local copy and...
This updates the `readthedocs.yml` file to version 2 (https://docs.readthedocs.io/en/stable/config-file/v2.html), primarily to set it to fail on warnings.