TheTechRobo

Cookies not staying

5

I'm trying to archive infos-ados.com and after I get the cookies (to stay signed in), and pass them through to grab-site, the WARCS aren't signed in, and my session in...

Should we add an anti-porn igset?

4

I don't watch, nor do I archive, porn. Should we add some porn sites to the global igset? Alternatively should we at least make an "antiporn" igset?

Could an admin of a SimpleMachineForum check if this is a page that is only accessible to moderators? I'm suspicious that the "Session verification failed" is because I'm not a...

this statement was rendered outdated with PR #203

How do you add custom hooks now?

3

I see they were removed, but I need them (I want wpull's youtube-dl functionality, but more advanced)

Pause gracefully if OSError (No space left on device)

4

Instead of crashing the crawl, why don't we simply pause and retry every so often if the computer has no space left?

infinite recursion on offsite links?

3

how would I go about enabling that?

Seems to work for me but I may have overlooked something Fixes #80

These ones: ```regex ^https?://tumblr\.com/widgets/share/ ^https?://www\.tumblr\.com/login ``` No point in grabbing login pages, and /widgets/share seems to be sort of like "compose post based on this website", sort of like the...

I thought it was something wrong with my regex ignoreset until I re-read the command I had run!