cdx_toolkit
cdx_toolkit copied to clipboard
enhancement: Rename WARC output
There is currently no option to rename an outputted WARC. For example, running the following command creates a file containing one record called TEST-000000.extracted.warc.gz
cdxt --cc --crawl CC-MAIN-2025-43 --from 20251016192109 --limit 1 warc 'commoncrawl.org/get-started'
There should be the option to rename this file (-n flag?). In addition, the default name should not be TEST but something like OUTPUT.
@malteos I can't assign people in this repo but did you want to work on this?