Hands-on-WebScraping icon indicating copy to clipboard operation
Hands-on-WebScraping copied to clipboard

Published 20 hours ago • verified publisher icon amitupreti

Pulling All Tweets

Open kozakalec opened this issue 4 years ago • 5 comments

Hey, quick question. When I ran this using that hashtag, BigData, it pulled all tweets containing the words data or big data. Why is it not only pulling tweets with the hashtag BigData?

kozakalec avatar May 12 '20 16:05 kozakalec

please pull again and try, it should now pull the hashtag.

Earlier the crawler was searching for the keyword when it should have been searching for hashtag.

superryeti avatar May 12 '20 16:05 superryeti

Interestingly, my results are similar. Results are saying that there are 0 hashtags reported when in actuality there are multiple hashtags associated to that tweet.

kozakalec avatar May 12 '20 16:05 kozakalec

Additionally, the "tweet_text" column is not showing the full text of the tweet. Often, only partials are being shown.

kozakalec avatar May 12 '20 16:05 kozakalec

thank you Much appreciated. please tag if you find other bugs.

I will update both tomorrow. For now. I will revert the latest commit.

superryeti avatar May 12 '20 16:05 superryeti

Thanks very much. Feel free to comment back/ping me if you believe the bugs are fixed. Thanks again.

kozakalec avatar May 12 '20 16:05 kozakalec