Alexander Gude

:-/ I haven't been able to reproduce the "Too Many Redirects" issue, and I haven't got a 520 error since updating the retry logic to cover 520s.

The XML sitemap vs list of URLs shouldn't make a difference, they're both processed offline (and with good test coverage) to the same format internally and then pass through the...

@Melonadev I've pushed [`v1.9.1`](https://github.com/agude/wayback-machine-archiver/compare/1.9.0...v1.9.1) which increase the redirect limit from 30 to 100. I don't expect this to fix the issue (if you have 30, I suspect it is actually...

So, interesting that you noticed a failure with a higher wait time in #21 ... Normally these infinite redirects are because the site is using a cookie to know that...

I too have been having issues, but through my scheduled runs of my script: - https://twitter.com/RaspberryPion/status/1331522966396366849 - https://twitter.com/RaspberryPion/status/1330084311110987777 - https://twitter.com/RaspberryPion/status/1328634615423123457 🤷 Let me know if you figure anything out!

Glad to hear it!

To answer the question directly: no, that flag is not currently supported. But I would be interested in getting it to work! ## Some Exploration Looks like when you click...

Yes, these is, and I don't yet have it documented in the README, oops! Here is how: Create a text file with one url per line, like this: ``` https://google.com...

Oh, good questions. Let me try to summarize them and answer: > Can I use `archiver` as a library so my own script can easily backup URLs? Not in it's...

Does it work if you go to the Wayback Machine website and archive the Twitter page? I haven't changed anything in the script, so it's possible they changed something on...