browsertrix-crawler icon indicating copy to clipboard operation
browsertrix-crawler copied to clipboard

Published 20 hours ago • verified publisher icon webrecorder

Support downloading seedFile from online source

Open tw4l opened this issue 5 months ago • 0 comments
trafficstars

Connected to https://github.com/webrecorder/browsertrix/issues/2312

Similar to custom behaviors, the crawler should be able to download a seed file from any accessible URL, simply by specifying a URL instead of filepath to --seedFile.

We should additionally validate the URLs passed in the seed file.

tw4l avatar May 28 '25 17:05 tw4l