cloudpathlib icon indicating copy to clipboard operation
cloudpathlib copied to clipboard

Implement caching based on file sizes and file content where possible

Open pjbull opened this issue 5 years ago • 1 comments

Sometimes we can use etags, Azure provides the md5 hash, some providers have "versions," and there may be other options. Currently trusting file times is a little flaky.

Can we store the etag info on the local file somehow natively? It would be good if this metadata was around to be used across processes, etc.

We aren't doing this now, but we should check file sizes before we even check times. If sizes are different, the files are definitely different. Then we can fallback to if times are different, they are possibly different. Then, hashes can confirm files are different.

pjbull avatar Aug 17 '20 17:08 pjbull

May be related to #49 as well

pjbull avatar Oct 02 '20 23:10 pjbull