kemono-dl icon indicating copy to clipboard operation
kemono-dl copied to clipboard

Duplicate file check

Open slormo opened this issue 2 years ago • 3 comments

Description

Kemono-DL sometimes duplicates attachments if any were previously downloaded. I think this is because the files change data servers and therefore get given a different name. A hash check might fix this but I'm not sure.

slormo avatar Oct 16 '22 21:10 slormo

I've noticed that too, but I gonna run dupe file scan for my drives occasionally, so I didn't look into that. Now I tried to fix it for us, hope it works well.

L4cache avatar Oct 17 '22 03:10 L4cache

The commit seems to detect dupes well, but now it runs really slow. Making it an optional setting might be a good idea

slormo avatar Oct 20 '22 23:10 slormo

The commit seems to detect dupes well, but now it runs really slow. Making it an optional setting might be a good idea

Just to say that the hash compare only takes place when no file with same name found and files with similar filename detected, other wise there's just some filename compare, shouldn't be a huge slow down, there may be some other problems.

L4cache avatar Oct 27 '22 06:10 L4cache