browsertrix
browsertrix copied to clipboard
Add WARC and WACZ size settings to org settings
Context
Currently WACZ files are split into ~10GB increments. We think this is a good default size, but some users ingesting these have expressed desire to dial in their exact preferences for both the WACZ files and their component WARCs.
Changes
- [ ] Rename the "Crawling Defaults" tab to "Crawling"
- [ ] Add a section below "Crawling Defaults" on the "Crawling" tab that can set both the WARC and WACZ sizes. WACZs cannot be smaller than their component WARCs.