ArchiveBot
ArchiveBot copied to clipboard
ArchiveTeam
ArchiveBot, an IRC bot for archiving websites
We should set up automatic regression testing. Specifically, we need to add a test that upgrading the pipeline and/or backend will not break things (unless that is expected). This is...
Having the ability to update jobs in the queue before they are ran would be adventagous. Things like changing the user agent in particular.
https://techpatterns.com/forums/about304.html has a decent list of such user agents. (Thanks Rotxer)
The IRC bot should always handle incoming messages in order, not starting with a later message until an earlier one has finished. I have confirmed that the received message order...
Following #367 and #383, the control node is now easily able to handle a couple hundred parallel jobs. However, the dashboard JS is unable to keep up with that. Earlier...
Not sure if this is a problem on my end or the dashboard end but trying to access the "Beta" dashboard on any of my ios devices results in Lost...
The current User Agents may do the job but I imagine that for example the firefox UA running on Windows NT may raise a few eyebrows. Perhaps updating the User...
When running an `!ao
I understand that we can't impersonate other bots but perhaps support for more User Agents could be possible. Perhaps an Opera User Agent even a Citrio User Agent could be...
Example: https://archive.fart.website/archivebot/viewer/job/82p8b This causes the search for "leoschmid.blogspot.com" to not return any results. There should be many, many more examples of this. According to the birthday paradox, the collision probability...
Metadata
Owner
Metadata
ArchiveBot, an IRC bot for archiving websites