ArchiveBot
ArchiveBot copied to clipboard
ArchiveTeam
ArchiveBot, an IRC bot for archiving websites
Bumps [rake](https://github.com/ruby/rake) from 10.3.1 to 12.3.3. Changelog *Sourced from [rake's changelog](https://github.com/ruby/rake/blob/master/History.rdoc).* > === 12.3.3 > > ==== Bug fixes > > * Use the application's name in error message if...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [ffi](https://github.com/ffi/ffi) from 1.9.6 to 1.11.1. Changelog *Sourced from [ffi's changelog](https://github.com/ffi/ffi/blob/master/CHANGELOG.md).* > 1.11.1 / 2019-05-20 > ------------------- > > Changed: > * Raise required ruby version to >=2.0. [#699](https://github-redirect.dependabot.com/ffi/ffi/issues/699), [#700](https://github-redirect.dependabot.com/ffi/ffi/issues/700)...
Added --ignore-existing to prevent overwrite issues as per issue #305
This PR re-enables the ignoracle tests and ports them to use the `Ignoracle` wpull 2 interface. It looks like the tests also caught a bug in the port: ``` $...
The pipeline has a hardcoded list of domains that must resolve to different IPs in order for jobs to start. Had the Facebook issues yesterday not been resolved as quickly,...
AB currently doesn't make use of wpull's `--http-compression` option, so it doesn't send an `Accept-Encoding` header. Occasionally, there are websites which hate that. For example, https://www.cresta-awards.com/ sends an empty response...
When a job crashes or is aborted, its DB and therefore its queue is simply deleted while the other things (WARC so far, JSON, and since #396 the log file)...
Last night, various things on the control node crashed. I haven't been able to establish the exact chain of events, but I believe that first either Redis or the trimmer...
Metadata
Owner
Metadata
ArchiveBot, an IRC bot for archiving websites