browsertrix-crawler icon indicating copy to clipboard operation
browsertrix-crawler copied to clipboard

Published 20 hours ago • verified publisher icon webrecorder

Support downloading seed file from URL

Open tw4l opened this issue 5 months ago • 0 comments
trafficstars

Fixes #841

Crawler work toward long URL lists in Browsertrix. This PR moves seed handling from the arg parser's validation step to the crawler's bootstrap step in order to be able to async fetch the seed file from a URL.

tw4l avatar Jun 17 '25 14:06 tw4l