sitespeed.io icon indicating copy to clipboard operation
sitespeed.io copied to clipboard

I want to crawl a custom sitemap.xml or CSV file

Open mgifford opened this issue 6 months ago • 1 comments

Feature/improvement

Is it possible to evaluate a list of URLs from either a custom sitemap.xml or CSV file.

Crawling is great, but there are times you want to actually be able to compare the same URLs you evaluated 6 months ago, with what you have now.

I know this is possible in Unlighthouse, and am a bit surprised it isn't in the documentation. I can't find it in the code either.

mgifford avatar Jan 10 '24 15:01 mgifford

Hi @mgifford you can run your test with a text file with each URL on a new row. I can make that more visible in the documentation.

urls.txt

https://www.sitespeed.io
https://www.sitespeed.io/documentation/

And run like this:

sitespeed.io urls.txt

Collecting from a sitemap maybe, but for now I would use some tool to parse a sitemap to a text file.

soulgalore avatar Jan 12 '24 07:01 soulgalore