twitterscraper
twitterscraper copied to clipboard
taspinar
Scrape Twitter for Tweets
So I'm trying to pull a dataset across 7 years for a modest query. I first tried one request with the standard pool size and I got around 40k results....
Is it possible to scrape the user bio also? This should be stored somewhere in the page html, and would be useful to grab.
Tweets with a URL in the end have it added to end of the text block without a space in between, causing many URL parsers not to detect the link....
Is there a way to scrape entire tweet threads instead of individual tweets? Twitter is now also rolling out new features for people to link their tweets in threads even...
--profiles will output a single user only for all the tweets. How to fix this?
Hi, Just installed twitterscraper Tried to run the example given in READ.ME from twitterscraper import query_tweets if __name__ == '__main__': list_of_tweets = query_tweets("Trump OR Clinton", 10) #print the retrieved tweets...
i'm crawling about 3000query for one day. after get 10000 tweets, my query response code is 429. it's means 'too many request' after 15minutes around crawling work again but i...
It could be great if `-bd` and `-ed` parameters could be `Datetime `fields instead of just `Date`. Because in some cases the minimum resolution (1 day) is too big to...
while scraping "clippers racism" between 2019-01-01 and 2019-02-01, the scraper collect 8 tweets and after that it does nothing. It seems that it's blocked when prompting: **Got 8 tweets (0...
Hello! I have noticed that I always get a completely different amount of scraped tweets for the same search. I am scraping all tweets with a certain hashtag - and...
