onlyfans-dl icon indicating copy to clipboard operation
onlyfans-dl copied to clipboard

Published 20 hours ago • verified publisher icon k0rnh0li0

Upgrade: Multithreading

Open threemica opened this issue 3 years ago • 3 comments

I want faster download times so I am going to mess around with multithreading. I've already gotten a user's download time from about 86 seconds to 36 seconds, so that is a pretty good decrease

I think I can increase the speed of the FInding photos... part of the code because a bunch of time is spent waiting for the server to respond.

I'll post some updates here and link the PR when I make it.

threemica avatar Mar 09 '21 21:03 threemica

Don't really know what is going on with the pagination so I may wait to implement that. Any insights on how to adapt that to multithreading?

threemica avatar Mar 09 '21 21:03 threemica

e.g. I was just able to rip 2,015 images from a user's profile in about 2.5 minutes

These changes have necessitated some changes to the download visual feedback, which I changed to a tqdm loading bar

threemica avatar Mar 09 '21 22:03 threemica

This is a great idea, I'd be interested to follow your progress. I didn't write the pagination scheme, it was submitted in a PR, but it's basically a way of splitting a user's posts up due to API limitations. I bet it would be really great for multithreading, you could have separate threads downloading each "page" or something like that.

Cool idea!!

k0rnh0li0 avatar Mar 11 '21 21:03 k0rnh0li0