browsertrix icon indicating copy to clipboard operation
browsertrix copied to clipboard

Published 20 hours ago • verified publisher icon webrecorder

[Feature]: Allow sitemaps to be specified as a seed URL

Open thsm-kb opened this issue 9 months ago • 1 comments

Browsertrix Cloud Version

v1.8.0-beta.2-3aebf2e

What did you expect to happen? What happened instead?

If I use https://www.sn.dk/sitemaps/term/Place.Sitemap.0.xml as a seed, it is not crawled. I do not get the files it links to.

Step-by-step reproduction instructions

  1. try crawling https://www.sn.dk/sitemaps/term/Place.Sitemap.0.xml as a seed.

Additional details

No response

thsm-kb avatar Nov 07 '23 08:11 thsm-kb