cloudpathlib

cloudpathlib copied to clipboard

Allow ignore_errors flag for CloudPath().rmtree()

3

Similar to the `shutil.rmtree()` method, allow the `ignore_errors` flag to be set for CloudPath instances.

ghost

"ExtraArgs" option is not available while uploading a file/folder to S3 via CloudPath

2

If users want to add User defined metadata tags while uploading to S3 they should be able to do so, but currently can't find a way for this using CloudPath...

gaisensei

Update docs: Use no_sign_request to fix "NoCredentials" Error when trying to access a public S3 bucket

1

I've outlined this issue in more depth here: https://stackoverflow.com/q/73708204/15739035 But essentially just using this simple code: ``` from cloudpathlib import CloudPath path = r"C:\some\path\to\folder" url = "s3://some-example-bucket/folder/" cloud_path = CloudPath(url)...

torrinworx

Anypath abstractmethods

4

Disclaimer: I quickly hacked this as a draft/suggestion. There might be better/nicer methods to achieve the same. I suggest to add some abstractmethods to AnyPath so that the methods available...

chbehrens

GCS live tests can be flaky on blob.patch

1

Workflow failed: [tests #580](https://github.com/drivendataorg/cloudpathlib/actions/runs/2896555882)

github-actions[bot]

Add boto3 extra_args field for upload operation

4

There are many use cases where uploading unencrypted objects to an Amazon S3 bucket is denied. For example an S3 bucket policy which enforces the encryption requirement when users upload...

benbemoh

Implement smart_open instead of .open() to allow efficient streaming (saving/loading) of large files to cloud bucket.

4

The current implementation of the .open methods consists of a local cache which is then synchronized with the cloud. This method can be replaced by [smart_open](https://github.com/RaRe-Technologies/smart_open), to allow for a...

hugolytics

LocalS3Path doesn’t support glob on non-existing directories

1

The implementations of S3Path and LocalS3Path diverge in the following way which disqualifies using `LocalS3Path` as a testing tool. ```python from cloudpathlib.s3 import S3Path path = S3Path("s3://this/path/does/not/exist") path.mkdir(parents=True) # does...

Quickblink

reset_default_storage_dir gets ignored through get_default_client

1

```python from cloudpathlib.local import LocalS3Path, LocalS3Client path = LocalS3Path("s3://some/path/") path.touch() LocalS3Client.reset_default_storage_dir() new_path = LocalS3Path("s3://some/path/") assert not new_path.is_file() # fails ``` The reason is that `reset_default_storage_dir()` acts on the class attribute...

Quickblink

Support SDK-specific retry parameters

2

Hi there. I tried looking in the docs to see if there was any support for explicitly setting number of retries for the Google Storage Client when writing to a...

jsungg