Adam Miller issues

Repositories
Issues
Comments

Results 9 issues of


                                            Adam Miller

Adding configurable MaxLogFileSize option to BdbModule

Adds trough dedup performance rework

feat: Add logging to crawl.log for metadata records created by ExtractorYoutubeDL

feat: AIT - Add logging to crawl.log for metadata records created by ExtractorYoutubeDL

feat: Detect connection failures forwarded from warcprox and retry th…

…em with backoff

feat: Add new cli option to insert url into existing crawl.

Handle redirect loop in generic extractor

**IMPORTANT**: PRs without the template will be CLOSED ### Description of your *pull request* and other information Fixes potential redirect loop in generic extractor on certain sites that do self...

bug

do-not-merge

Adam Miller