google-maps-scraper icon indicating copy to clipboard operation
google-maps-scraper copied to clipboard

How to get more than 8 reviews?

Open maaz-munir opened this issue 1 year ago • 7 comments

Currently it returns 8 user_reviews per location. I want to scrape a single location but get all the user reviews available?

Is there a parameter for this available? Or a way to get reviews sorted by "New"?

maaz-munir avatar Dec 27 '24 12:12 maaz-munir

@gosom I noticed that you are using the window.APP_INITIALIZATION_STATE object to scrape the data from a gmap link.

Is there a similar object available for cases where I might need more reviews? Or for example, I want reviews based on a different sort order

Or since they are different fetch requests and just update the DOM on the fly, the only option is to use playwright locators?

maaz-munir avatar Dec 31 '24 13:12 maaz-munir

I believe it's possible to get the reviews with a different way but they are not available on the page

gosom avatar Jan 01 '25 08:01 gosom

It would indeed be of great help, although I understand this may not be technically feasible.

@maaz-munir, did you figure out a way?

itsmevictor avatar Mar 25 '25 10:03 itsmevictor

@itsmevictor I ended up using playwright itself to get the reviews

maaz-munir avatar Mar 25 '25 19:03 maaz-munir

@maaz-munir @itsmevictor

I added support to get extra reviews. It is still experimental , enable using -extra-reviews flag.

https://github.com/gosom/google-maps-scraper/releases/tag/v1.8.0

Can you please test and let me know how it works for you?

gosom avatar May 11 '25 10:05 gosom

@maaz-munir @itsmevictor

I added support to get extra reviews. It is still experimental , enable using -extra-reviews flag.

https://github.com/gosom/google-maps-scraper/releases/tag/v1.8.0

Can you please test and let me know how it works for you?

I tested locally it works great! Thanks for the feature. BTW, I see currently postgres dump will only store all field as a json which requires additional type casting if you wan to process further on each field. Are you willing to accept PR which include structured table shema and go model for postgres? Happy to contribute

doublenine99 avatar May 16 '25 04:05 doublenine99

hey @gosom , i have abit question: why with -extra-reviews only get around 300 reviews ? Any solution for get more reviews ?

vmintam avatar Jun 12 '25 13:06 vmintam