nasty icon indicating copy to clipboard operation
nasty copied to clipboard

Problem retrieving tweets which contain emojis only

Open ana-sofia93 opened this issue 4 years ago • 1 comments

When inspecting the tweets retrieved with the nasty search command, I encountered the following problem:

If a tweet contains only emojis but no text, it cannot be crawled.

Example tweets: https://twitter.com/McDonalds/status/1258532072634724354 https://twitter.com/McDonalds/status/1258894470055149572

Exemplary code for the command line: nasty search --query “(from:@McDonalds)” --max-tweets -1 --since 2020-05-08 --until 2020-05-10 --filter LATEST > mcs.json

It would be possible that my parser does not work as intended, although I have no problems retrieving tweets which include text + emoticons / emojis. However, it might also be a bug in the nasty tool?

ana-sofia93 avatar Nov 12 '20 15:11 ana-sofia93

Yes, this seems to be a bug. I just managed to replicate the problem on my end (also with a more recent McDonalds emoji only Tweet). Thanks for reporting this.

However, at the moment I have no idea what might cause this and can't give you an estimate until when I will manage to fix this. Also, I am fairly confident that I managed to retrieve emoji only Tweets in the past. Weird.

Could be related to #4.

lschmelzeisen avatar Nov 12 '20 16:11 lschmelzeisen