cloudpathlib icon indicating copy to clipboard operation
cloudpathlib copied to clipboard

Sync for cloud/local folders

Open pjbull opened this issue 4 years ago • 2 comments

We don't currently support any sync API. Even with upload_to and download_from, we will never delete files.

I'm not sure that we need/want to do anything about this, but wanted to capture some thoughts as I considered it. There are two options that I could see being reasonable:

  • Explicitly document sync as a non-goal - Add to documentation and link to tools that sync cloud/local
  • Add a sync API - we can probably do this just with copytree + removing files that don't exist on the source. That said, I don't think we want to be a sync tool so we should document this is for convenience, not performance.

pjbull avatar Mar 13 '21 19:03 pjbull

You definitely should add sync, otherwise you force users to have to get it from somewhere else. I am pretty sure that at least S3 and Azure both support it in their client API.

analog-cbarber avatar Sep 01 '21 14:09 analog-cbarber

AWS S3 supports it with their CLI, but not with the boto3 SDK, which makes it a key feature that I would love to see happen in this library.

ypicard avatar Jan 30 '22 18:01 ypicard

Duplicate of #14. Consolidating.

pjbull avatar Dec 19 '22 00:12 pjbull