fantiadl icon indicating copy to clipboard operation
fantiadl copied to clipboard

Skip posts with already downloaded content as a whole instead of each file on its own

Open Rennschnitzl opened this issue 2 years ago • 2 comments

When rerunning the program with the same parameters (download all pay for current month) after the last run failed and only downloaded partial posts or a new creator has been added:

the download takes forever especially on posts with larger image galleries because every file gets requested and then skipped if already on the disk.

would it be possible to keep track of already downloaded posts? or at least check if a post has been modified since the last download.

Rennschnitzl avatar Mar 30 '22 22:03 Rennschnitzl

You may need rdfind -makehardlinks

unknown10777 avatar Oct 04 '22 10:10 unknown10777

I have the same feeling that updating the image database is very slow. I suggest skipping posts with the same number of files and downloading complete ones, downloading new posts, and re checking for incomplete posts.

If you can specify a post to download after a certain date, it may also be helpful. (But it doesn't seem very intelligent)

1223334444abc avatar Jun 24 '23 04:06 1223334444abc