ios icon indicating copy to clipboard operation
ios copied to clipboard

AutoUpload: skip existing

Open lobeck opened this issue 3 years ago • 9 comments

Due to the various logout bugs, there is a gap between the Camera Roll and what's on the server. So my idea was to use the "Upload full camera roll" setting to get a consistent state again.

There I noticed, that it will really upload all files again, even though many already exist on the server. This is noticeable especially with Videos that will be fully uploaded and replace the existing files.

My camera roll contains 30.000 pictures and videos by now, so it's literally taken days to make progress.

It would be really nice, if the app would just skip files, where the metadata matches what it currently tries to upload. It will be still a lot of requests to the server then, but only minimal data transfer and thus much faster progress

lobeck avatar Jun 30 '22 16:06 lobeck

For reducing the unnessecary uploads of already existing files I suggest to (and I don't know if we have this option):

Instead of creating the filenames of date, time and a device specific identifier, use an identifier that uniquily identifies the picture. I believe that iOS must have something like that for its own photos synchronization. I don't know, if we can use it.

Having a proper identification of the file, check if file is already existing (and not modified) and skip upload. That's it.

If we don't have such an identifier, I suggest to store hash values on the server and work with those.

ne20002 avatar Jul 04 '22 06:07 ne20002

The default naming scheme is consistant across uploads. I have the same problem as the OP - but with "only" 5'800 photos and videos - and using the current, default, naming scheme, there are no duplicates on the server : images and videos are just re-uploaded and they replace the files that were there. So the ability to check against filen ame and file size should be enough. For good measure, make that a toggle option - in case someone actually wants to overwrite the files on server.

ymauray avatar Jul 26 '22 06:07 ymauray

The default naming scheme is consistant across uploads. I have the same problem as the OP - but with "only" 5'800 photos and videos - and using the current, default, naming scheme, there are no duplicates on the server : images and videos are just re-uploaded and they replace the files that were there. So the ability to check against filen ame and file size should be enough. For good measure, make that a toggle option - in case someone actually wants to overwrite the files on server.

I just did a test of this. If the "Upload full camera roll" toggle is turned on, it will indeed re-upload everything regardless if files are already present. There is no check.

Would it be possible to have this delta upload in case the configuration gets reset ?

Zegorax avatar Dec 16 '22 10:12 Zegorax

I am baffled at how this piece of core functionality does not exist as a feature

mrwhizzy avatar Jul 30 '23 09:07 mrwhizzy

Facing the same issue, the app reuploads everything after I reset the server (I kept the files).

oliverhu avatar Jan 07 '24 23:01 oliverhu