Jay Qi
Jay Qi
S3 has an interesting situation with folders. Like other object stores like Azure, it has a flat structure, and when you upload a file to `a/b/c.txt` for example, it creates...
We should document alternatives to cloudpathlib. The only one I've seen is https://github.com/liormizr/s3path One common way this is done is to have an `## Alternatives` section towards the bottom of...
Our CI tests currently only test the `[all]` dependency configuration. This fails to surface problems when missing optional dependencies cause runtime errors, e.g., the error fixed by #170. (Luckily, our...
If you're processing a lot of data in a loop and want to reclaim disk space after you're done with one path, then it could be helpful to have a...
A pass at trying to detect when `__fspath__` is called by `open` with a write mode. IMO it doesn't work all that well. It appears `open` is a weird function...
`CloudPath.replace` and `CloudPath.rename` (which are the same function for cloudpathlib) do not handle "directories". The pathlib docs say: ``` Rename this file or directory to the given target, and return...
Unfortunately the following code does not behave as expected: ```python with open(cloud_path, "w") as fp: fp.write("foo") ``` (as opposed to using `cloud_path.open("w")` which does work as expected). What will happen...
We didn't catch #115 because our CI only uses the `all` dependency case. We should think about testing cloud dependencies separately to catch these kinds of issues.
Implementation of `FsspecClient` and `FsspecPath` that work with an fsspec concrete filesystem implementation. Follow up on #96 --- - New abstract `FsspecClient`, `FsspecPath` classes. Each registered implementation in [fsspec.registry](https://filesystem-spec.readthedocs.io/en/latest/_modules/fsspec/registry.html#ReadOnlyRegistry) has...
Known issues, gotchas, things to be careful of - [ ] directory weirdness for cloud storage - [ ] explain default client + credentials system - [ ] explain that...