platform.js icon indicating copy to clipboard operation
platform.js copied to clipboard

Parse google bot information?

Open jennysjogren opened this issue 11 years ago • 7 comments

The Google bot sometimes uses the iPhone Safari ua, but with additional google bot information Example ua:

Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

It would be useful if the bot information in the ua got parsed and assigned to a platform property.

jennysjogren avatar Sep 17 '14 08:09 jennysjogren

I’m not too sure about whether we want to start adding support for bots. @jdalton what do you think?

bnjmnt4n avatar Sep 17 '14 09:09 bnjmnt4n

We detect simulators so I see this as something along those lines. If we can make the detect generic that would rock if not I think the Googlebot is common enough to warrant inclusion.

jdalton avatar Sep 17 '14 15:09 jdalton

make the detect generic

I’m not too sure what you’re referring to here, but I can add the data for Googlebot.

bnjmnt4n avatar Sep 18 '14 01:09 bnjmnt4n

I’m not too sure what you’re referring to here

I believe we look for things like Simulator maybe we could also look for bot or manufacturer+'bot'.

jdalton avatar Sep 18 '14 06:09 jdalton

What would we call this class of user agents and where would this information be accessible from on the platform object?

bnjmnt4n avatar Sep 18 '14 08:09 bnjmnt4n

We haven't tackled that, it's been just added to the description. If you want there could be boolean properties for simulator and bot.

jdalton avatar Sep 18 '14 17:09 jdalton

Hey @jdalton @demoneaux, is this still on the radar?

Here is the latest from Google and Bing for their bots, if that helps:

Google: https://support.google.com/webmasters/answer/1061943?hl=en Bing: https://www.bing.com/webmaster/help/which-crawlers-does-bing-use-8c184ec0

oyeanuj avatar Mar 07 '17 19:03 oyeanuj