cloud-files
cloud-files copied to clipboard
seung-lab
Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.
Why can't you just write: ```python binary = download("s3://wow/omg/amazing") # or even dl("...") ``` Instead you have to write: ```python binary = CloudFiles("s3://wow/omg/").get("amazing") ```
CloudVolume already has this feature, we would just need to integrate and polish it.
Right now I'm sort of getting this tested by proxy via CloudVolume's tests. It's ugly though.
It'd be nice if CF could transparently take advantage of multipart uploads for very large files. https://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html https://cloud.google.com/storage/docs/composite-objects
Here's the current coverage report as of Feb. 19, 2024. ```Name Stmts Miss Cover Missing ---------------------------------------------------------------- automated_test.py 757 26 97% 288, 439, 754-755, 758, 762-763, 823-824, 845, 888-889, 894-895, 902-903,...
Hi Will, I used cloudvolume to upload a simple greyscale image volume in precomputed format to google cloud, as I've done a million times. The upload seemed to succeed without...
