public-roadmap icon indicating copy to clipboard operation
public-roadmap copied to clipboard

[Google Search API] Scrape new carousel layout

Open sonika-serpapi opened this issue 1 year ago • 3 comments

A customer reached out with a request to scrape the new carousel layout found in some google search results, which is of high interest to them.

Here is an example search where I see the carousel, but it is not in the SerpApi response: https://serpapi.com/playground?q=best+chinese+nyc&location=Austin%2C+Texas%2C+United+States&gl=us&hl=en&device=mobile

I see a couple different carousels in the response: First - it is part of a result: Screenshot 2024-11-15 at 11 15 27 AM

Second - it is for "Nearby offers and events": Screenshot 2024-11-15 at 11 30 53 AM

Third - it is for "Shanghainese restaurants" and includes a couple dropdowns: (Customer included this one in the request specifically) Screenshot 2024-11-15 at 11 24 43 AM

Related link provided by customer: https://developers.google.com/search/docs/appearance/structured-data/carousels-beta

Public links: Playground 1

Internal links: Front | Search Inspect 1

sonika-serpapi avatar Nov 15 '24 19:11 sonika-serpapi

This would be amazing!

rodcox89 avatar Nov 19 '24 21:11 rodcox89

These new "new carousel layouts" seem to be loaded separately outside the initial page load. Might not be possible to scrape these elements with a single request.

Seems to be targeting google.com / US specifically (for now).

Playground Example

Playground Example (working - google.co.uk) Image

btaunt avatar Apr 08 '25 01:04 btaunt

A user requested this:

Front

oceansize avatar Jun 30 '25 15:06 oceansize