crawler-user-agents
crawler-user-agents copied to clipboard
Few Google bots are not considered
Description
We are seeing traffic from these two user-agents:
-
Mozilla/5.0 AppleWebKit/537.36 Chrome/126.0.6478.126 Safari/537.36 Google-Ads-Conversions -
Mozilla/5.0 (iPad; CPU OS 9_1 like Mac OS X) AppleWebKit/601.1 (KHTML, like Gecko; compatible; pageburst) CriOS/79.0.3945.117 Mobile/13B143 Safari/601.1.46
References
- isbot considers them as bots.
- IP seems to be from Google https://www.ip-tracker.org/lookup.php?ip=66.249.89.36.
- https://user-agents.net/string/mozilla-5-0-ipad-cpu-os-9-1-like-mac-os-x-applewebkit-601-1-khtml-like-gecko-compatible-pageburst-crios-79-0-3945-117-mobile-13b143-safari-601-1-46-ip-74-125-150-66
- https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers
Thanks! Would you you make a pulll-request to add Google-Ads-Conversions and pageburst?
Closed per https://github.com/monperrus/crawler-user-agents/pull/412