cloudpathlib

cloudpathlib copied to clipboard

Both S3 and Azure have HTTP versions of the paths that we can parse the same information from. Can we accept these formats and parse out the important pieces? E.g,:...

pjbull

Add FTP backend

4

Should support both ftp and sftp (ftp over ssh). There's some code that will help with this in the `zamba-web` project

pjbull

We probably do a lot of things that are network bound and disk read/write bound. May be worth it make some of these play nice with async. Before we implement...

pjbull

Right now you need to know your bucket or container ahead of time, but most services provide a way to list the buckets or containers you can access. Could be...

pjbull

A call like `cloud_path.download_to("a/b/c/d.txt")` will possibly (though not certainly depending on backend, see #56) error if local directories `a` or `b` or `c` does not exist. This is similar to...

pjbull

We've experimented with this tool for fast bucket-to-bucket transfers. It would be cool if we could leverage the logic here to make an incredibly fast bucket-to-bucket transfer: https://github.com/generalui/s3p/ Here's a...

pjbull

It would be cool if Clients had a `progressbar=True` kwarg that let me say whether or not I want a progressbar when uploading/downloading that will get displayed. Probably would be...

pjbull

We don't have a full definition of what we rely on each backend function to do. For example, this just came up in #52 when we were discussing if `_download_file`...

pjbull

- Project goals: - As close to pathlib as possible; extra properties/methods for critical cloud-specific functions - Support for different backends is easy to implement - Only download files locally...

jayqi

There are probably some libraries that we want to test integration with, even it is not part of normal CI. For example, this makes me remember that if pandas gets...

pjbull