ripme
ripme copied to clipboard
Time Argument/Feature
For a large number of links a re-rip is still slow even though it is skipping a good number links and not downloading the file.
A new feature to set how far back history is checked might help reduce this. For a reddit page I'd suggest sorting by new and scraping the post date/time. The rip for an account would then stop when it hits the argument's given time or older.
The logic would need to be based on the reddit post not the imgur item because of reposts pre-maturely stopping the rip. It wouldn't be a good idea to sort by new and stop when an existing file is found for the same reason.
The old rip site would stop as soon as it hit a file it's already seen. Unfortunately, this implementation downloads & checks for existing files inside a separate thread, making a full-stop nearly impossible.
I'll take a look and see if I can hack something up.