derpibooru-downloader icon indicating copy to clipboard operation
derpibooru-downloader copied to clipboard

Published 20 hours ago • verified publisher icon Sibusten

Asynchronous Requests

Open GrayEye opened this issue 4 years ago • 2 comments

Hello, I noticed while using this program that is seems to wait for one picture to finish downloading before it begins the next. This is terribly inefficient and causes outrageous wait times to try to download anything more than a few hundred pictures. This could be solved by creating batches of asynchronous requests, say keeping 10 open at a time just to pick a number, so that we can download more efficiently. Thank you for your work!

GrayEye avatar Dec 07 '20 00:12 GrayEye

I will be looking into async downloading in v3.0

Sibusten avatar Dec 20 '20 13:12 Sibusten

Love the idea, just make sure to add pipe control to it so the program doesn't get the same request twice.

AndrewTru avatar Mar 12 '24 13:03 AndrewTru