Nandaka
[Sankaku] Resuming/restarting batch download from page > 50
Hi, Nandaka. I was trying to resume batch download for a tag, starting from page 100+, but it could not find the page(404). I have my login info setup, this is no issue. So I set the start page=50, it scan through my existing images and skip them till where the last task was left off, then it works fine. The problem is if I do this every time, say I have a tag with 1000+ pages in total and I already downloaded 300 pages, and the program start scanning my images from page 50, it will take so many time just for checking and skipping files I already got. (Plus Sankaku has a requests limit so we have to wait...)
I wanda if we could find a way to fix this.... Thanks :)
I might find a way from here, using Method 2: how to go over the 1,000th page of Sankaku Complex But I don't know if there is any side effect. This means, if Sankaku is ordering their page by date, with page 1 the latest and last page the oldest files, then it should be fine.
PS: A little inspiration from the tips.
We might also be able to use %id% = Image ID to resume the batch download since images are orderd?
Maybe something in the tags query like tag+%id%<=<ID of last image downloaded>??
Sorry, i am no programmer. If there is actually a way to do, please let me know.
Try to add &next=<post id> on the search tag?
https://github.com/Nandaka/DanbooruDownloader/issues/162#issuecomment-372074437
Theoretically yes, but isn't it the same issue that you mentioned before? Say I want to resume the work from page 1000, than I need the last image id from page 999 or the first image id from page 1000, which is not possible unless you click the next page button from page 50 till 1000... Correct me if I understand it wrong.
Yes, but with some limitation, as I need to get the post id from the previous page to make it works. so If you try to jump to page 100, I need to get the last image in page 99, which in turn I need to fetch the previous image from page 98 and so on until it hit the page 50 (as this is the limit for normal user). This is not effective, unless you are ok to key in the value of ?next=<first_image_in_target_page> every time you query sankaku with page > 50.
Sankaku doesn't allow you to go directly to page >50 without adding the &next=<post_id> unless you are registered with level=Contributor
Tested with newly created account.
The only way to get page > 50 is by iterating from page 50 onwards just to get the next image id.
The other possible solution is by adding date:2018-03-27 in the search tag just so it allow you to search from 1 again or become a contributor.
