python-user-agents icon indicating copy to clipboard operation
python-user-agents copied to clipboard
verified publisher icon selwin

Spider/Crawler Google Favicon not detected as Spider

Open ghost opened this issue 3 years ago • 0 comments

Google Favicon is the user agent for downloading favicons defined by websites. https://developers.google.com/search/docs/advanced/appearance/favicon-in-search#crawler

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko)  Chrome/49.0.2623.75 Safari/537.36 Google Favicon

ghost avatar Jul 29 '22 10:07 ghost