actor-google-search-scraper icon indicating copy to clipboard operation
actor-google-search-scraper copied to clipboard

Remove extra items from relatedQueries

Open metalwarrior665 opened this issue 5 years ago • 0 comments

From one of our users

Since Thursday of last week, we've seen additional items coming back in the response in Apify's relatedQueries set. We believe this is due to a design change Google made to their search engine results page.

The last 8 items of the relatedQueries in this set correspond to what have typically been listed at the bottom of Google SERPs. However, the first items in the list do not seem to be part of the typical related searches set. They are:

Brand Names that Google thinks are related to the search (in the example above "MailChimp", "Sendgrid", "ConstantContact", etc
Or - Mis-interpreted page elements that have been scrapped ("See More" and "Feedback").
I've attached a screenshot to show an example of this SERP.

I believe the buttons and miscellaneous page elements should definitely not be included in the relatedQueries list.

It would be ideal if the relatedQueries could be kept to ONLY the 8 suggestions above the navigation, and the branded terms either removed or kept in a separate part of the response.

We should make a separate fields for these

related queries

metalwarrior665 avatar Mar 01 '21 21:03 metalwarrior665