cloudpathlib

cloudpathlib copied to clipboard

[These methods](https://github.com/drivendataorg/cloudpathlib/blob/08b018b36f90f89003e0c9e5ebd19030b41c2433/cloudpathlib/cloudpath.py#L684-L719) essentially wrap the `open` context manager. The `open` context manager accepts force overwrite kwargs: https://github.com/drivendataorg/cloudpathlib/blob/08b018b36f90f89003e0c9e5ebd19030b41c2433/cloudpathlib/cloudpath.py#L552-L553 Would you support a PR that: * adds `force_overwrite_from_cloud` to `read_{text,bytes}` * adds...

hwong557

Unable to load files with a colon in filename (Windows Client only)

3

Filenames on cloud are allowed to contain colons, but it is not allowed in Windows filenames. When a file is downloaded from a cloud it is first saved in a...

glusin

Fixes for LocalClient bugs: glob in local clients to match cloud clients, reset default storage work on default client

3

- `glob` for local clients should return empty list (to match cloud version) rather than raise exception. - Reset default client in `reset_default_storage_dir` so the new storage dir gets picked...

pjbull

Allow to pass boto3 client to S3Client

3

Currently the S3Client needs the credentials to be used, but what happens if i already have a boto3 client somewhere initialized and i want to use the S3Client class? Is...

abourramouss

This change is intended to make the default client implementations more flexible so that their scheme can be customized. This can be useful in scenarios where a subclass wants to...

kujenga

Currently, the guidance for accessing S3 compatible stores recommends continuing to use the S3 scheme in the path: https://cloudpathlib.drivendata.org/stable/authentication/#accessing-custom-s3-compatible-object-stores I'd like to be able to take this a step further...

kujenga

Read from http - httppathlib?

3

### Best approach to support reading data from http via a `pathlib`-like class, i.e. `httppathlib`? In the [pangeo](https://pangeo.io/) / [xarray](https://xarray.dev/) community we do a lot of reading of remote scientific...

TomNicholas

Copy to non-existing S3 folder path creates a file with "/" instead of file name in that folder

1

Steps to reproduce: ```python # take an existing file src = S3Path("s3://my-bucket/file.txt") # and copy it into non-existent folder dst = S3Path("s3://my-bucket/destination/") src.copy(dst) ``` **Current behavior** Creates a file with...

quantori-pokidovea

WIP: Implement HTTP

6

Initial pass at http. - implemented with standard library - tested against Python `http.server` - will try writing/deleting files with PUT/DELETE in case your server allows it - will try...

pjbull

There are a few limitations to our current implementation for glob in newer versions of Python. In #474, we introduced `cloupathlib/legacy/glob.py` that has CPython code that was removed in 3.13,...

pjbull