DeviantArt: Downloading a DA artist directory only downloads Featured images, not all images

[Phenrei]

If you point directly to the full image collection of an artist instead of a subgallery, it only downloads the featured section (sometimes empty, usually not every image) instead of the all images category because the sanitizer filters out the "?catpath=/" part.

I coded a half-fix (it breaks the rip stopping on its own for a reason I can't figure out) that is here: https://github.com/Phenrei/ripme/commit/8a68c79047173a911b4bab523407cec6d0cce5af (ignore the first change).

Short version of it is a quick regex to see if it's base directory or not, and if so keep the ?catpath=/ in all rip URLs. Feel free to clean up, fix my bug, and take all credit.

[Phenrei]

I realize now it would probably be better to check for the user putting the all images or scraps (?catpath=scraps) parts in the url when sanitizing and then re-add those elements during string creation based on them being present. Just have to move the booleans to the class definition instead of local, but the rest would be similar.

[4pr0n]

Thanks for pointing this out. I'll take a look at your changes and see what can be pulled/borrowed.

[rautamiekka]

https://github.com/4pr0n/ripme/issues/550

[metaprime]

@rautamiekka Is this the same issue or just similar? Can we leverage the change posted here?

[rautamiekka]

^ Similar. The change linked in OP potentially fixes the recursive ripping.