serpapi
[Google Search API] Scrape Refine Results Sidebar
Some Google Search results pages have a "Refine Results" sidebar with boxes that can't be checked. We are currently scraping the refine results pils at the top of the page, but not the sidebar.
I haven't verified whether the items in the sidebar are identical to the items in th pils, but unlike the pils they are organized into categories.
A user suggested we scrape this sidebar.
Intercom | Playground | Inspector
A customer reported this:
And also gave this extra context:
The reason for this is that for e-commerce queries Google has been transitioning to an e-commerce storefront category page UI in universal search with filters and product grids etc, we want to capture the filters that appear for different queries since it is dynamic and acts as query refinement so when the user clicks a filter it subsequently performs another search against that new query - this is very useful to extract these for our SEO e-commerce clients!
We now parse these refined results under refine_search_filters for Google Search API:
