TumblThree icon indicating copy to clipboard operation
TumblThree copied to clipboard

Rescan issues

Open T-prog3 opened this issue 2 years ago • 3 comments

I recently ran Force rescan on some blogs and noticed first of all that this function doesn't automatically reset to False after its done. But also when i manually set it to False in Blog Settings or config file then the software continues as if its still True and look through the complete blog and wont stop at last complete crawl or latest post date. It took hours to complete only 10 new posts.

T-prog3 avatar Dec 26 '23 18:12 T-prog3

I wouldn't classify the missing automatic reset as an error.

Once a Force rescan has started, it needs a complete error-free run, either the current one or any future one, to set a new LastId (Last Complete Crawl/Latest Post are irrelevant).

So in your case you can set LastId to any current post id to stop the long scans.

thomas694 avatar Jan 04 '24 22:01 thomas694

The main issue is that even when i complete the download it still look through full blogs on every run so far. And every post show up as already downloaded, skipping and with the rate limits this can take hours to complete.

One thing i miss is some sort of indicator that show if it download the blog as normal or with Force rescan enabled in the download Queue. Like a F before the star ratings or something. I know that you can look for the check mark in details but this can be tedious with a large amount of blogs and in my case none have that check mark and still it look through it all.

I was under the impression that LastId was the id of the Latest Postdate found and that the scan wouldn't go beyond this date unless rescan was enabled? So does the downloader have to encounter this id to stop? And what happens if this id got removed by the blog or twitter/tumblr?

T-prog3 avatar Jan 29 '24 02:01 T-prog3