google-play-scraper icon indicating copy to clipboard operation
google-play-scraper copied to clipboard

Confusion about reviews' "title" field

Open LinqLover opened this issue 3 years ago • 6 comments

Each review contains a field named title, but in our scenario, it is always null. I took a look at the code and found the following confusing fragments:

  • https://github.com/facundoolano/google-play-scraper/blob/50502284a7f6d2ffbf21a5b12feca1fe4a19f13d/lib/utils/reviewsList.js#L30-L33
  • https://github.com/facundoolano/google-play-scraper/blob/50502284a7f6d2ffbf21a5b12feca1fe4a19f13d/test/lib.reviews.js#L17

What is this about? Is this a feature "not yet implemented", does this exist for backward compatibility, or is it simply a slip? Should API users use or ignore this field in order to collect a maximum of useful data?

It would be great if you could answer this question and, ideally, add short documentation of it in the readme.

LinqLover avatar Jul 08 '20 16:07 LinqLover

Apparently, this change was introduced via #341. @icarcal Could you maybe enlighten us? :-)

LinqLover avatar Jul 08 '20 16:07 LinqLover

Looking at the documentation, I assume this is a feature for backward compatibility indeed:

Property name Value Description Notes
[...]
comments[].userComment.text string The content of the comment, i.e. review body. In some cases users have been able to write a review with separate title and body; in those cases the title and body are concatenated and separated by a tab character.
[...]

Please let me know if this assumption is correct. Documentation would still be nice. :-)

LinqLover avatar Jul 08 '20 16:07 LinqLover

@LinqLover this is indeed for backward compatibility. Google seems to be returned the title in some old comments, and we can probably add the mappings again to have null or the title in case this exist.

icarcal avatar Jul 20 '20 22:07 icarcal

Thank you @icarcal for the feedback. It might be helpful to document this decision directly in the repository. :-)

LinqLover avatar Jul 20 '20 23:07 LinqLover

I found the comment, explaining why I did this https://github.com/facundoolano/google-play-scraper/pull/337#discussion_r322223733

I had this "documented" by a comment in reviews example, but it was probably lost. Going to add this again, thanks for pointing that out.

icarcal avatar Jul 21 '20 00:07 icarcal

@icarcal is this added back again? I still seem to only have "null" titles 😅

ivanhjel avatar Mar 29 '22 13:03 ivanhjel