cloudpathlib

cloudpathlib copied to clipboard

Module fails to import when Python is ran with -OO

1

Since `-OO` removes docstrings, the module fails on import as shown in the following trace: ```python [...] from cloudpathlib import AnyPath, CloudPath File "/home/javier/.virtualenvs/WebsiteTopicClassifier/lib/python3.6/site-packages/cloudpathlib/__init__.py", line 3, in from .anypath import...

jruere

Can't use cloudpathlib with mypy

2

I'm interested in using cloudpathlib in my project, but I'm currently not able to because of the following error: ``` [file in my project]:8:1: error: Skipping analyzing "cloudpathlib": module is...

sid-kap

Add ability to turn off caching (or automatically remove it once files are uploaded or loaded into memory)

4

I've been writing large files to s3 something like this: ``` with dest_path.open('wb') as f: torch.save(model.state_dict(), f) ``` where dest_path is something like `s3://bucket/path.pt`. The bug is that I see...

pbridger

Currently, API reference docs do not show inherited methods. This may have been a known issue with mkdocstrings updates in the last few months but I'm not recalling the details...

jayqi

Support FastAPI jsonable_encoder (through docs or Pydantic config)

2

By default, if I have `AnyPath` as a type in a Pydantic model used by FastAPI in a `response_model` config for a route, FastAPI cannot resolve an appropriate json encoder...

kabirkhan

Add `as_url` method to each CloudPath implementation with ability to generate presigned_urls

1

## Overview Adds an `as_url` method that returns the `https://` address of the object or generates a presigned URL if `presign=True` is passed. Based on https://github.com/drivendataorg/cloudpathlib/issues/235 ## Usage ```python from...

kabirkhan

glob does not work on Python < 3.7.6

7

Hello, I tried your promising 0.7.0 version this morning, however, the glob function breaks for me now: ```python directory = S3Path('s3://sertit-extracteo-ci/water') directory.glob('*S2*_MSIL2A*') ``` throws: ``` self = S3Path('s3://sertit-extracteo-ci/water'), pattern =...

remi-braun

Generate Presigned URLs

4

## Overview It's nice to be able to generate presigned URLs for download/upload so you don't need to worry about passing around auth credentials. It's often a little non-obvious how...

kabirkhan

Implement partial or streaming reads/writes (CloudFile abstraction)

5

Currently, if you want to read a file we download the whole file and then open it for reading. Most backends will have some way to do streaming reads. We...

pjbull

missing_ok kwarg for unlink diverges from pathlib defaults

2

For the `unlink` function, `missing_ok=True` by default. The default in `pathlib` is `missing_ok=False`. This has always been the behavior, but as of #230 it is made explicit. If we want...

pjbull