Google Pagespeed

Open rogierslag opened this issue 6 years ago • 1 comments

Google pagespeed fires requests to our servers as Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5 Build/MRA58N) AppleWebKit/537.36(KHTML, like Gecko) Chrome/69.0.3464.0 Mobile Safari/537.36 Chrome-Lighthouse but is not detected as a crawler.

I can imagine that some might want to consider this a crawler as well, though I'm not 100% sure what would work for everyone.

Note that the Lighthouse audit plugin from Chrome uses the normal User-agent value of the browser.

Feb 24 '19 09:02 rogierslag

Should this be considered as a crawlar?

Jul 09 '19 20:07 rogierslag