twitterscraper
twitterscraper copied to clipboard
Scrape Twitter for Tweets
The HTML element that the video url was getting scraped no longer exists, so `video_div.find('a')` returned `None`, and this made tweets containing videos fail getting scraped. I changed it to...
Hi, How to get the tweet geolocations in the scrapped data?
For some of the downloaded tweets I see number of replies greater than 0. How can I download these replies using twitterscraper?
Hi, Currently, running query_tweets prints a large number of logs, which sometimes crash the browser session (for eg. if you use Google Colab) especially if you are iterating over a...
This code still work a few days ago but today I run the code it has this error Traceback (most recent call last): File "C:\ProgramData\Anaconda3\envs\twitterAPI\lib\site-packages\urllib3\connectionpool.py", line 672, in urlopen chunked=chunked,...
Great package but it issues a lot of logging messages at INFO level. I tried setting the log level to WARNING but twitterscraper sets it back to INFO when imported.
Everything was fine yesterday, but today when I was trying to import twittersrcaper in my jupyter notebook again, I got this error: HTTPSConnectionPool(host='free-proxy-list.net', port=443): Max retries exceeded with url: /...
I believe some people may have concerns considering #60 #112 about the legality of this, but last year might have changed this. Although this, is probably already well known, I...
Hello @taspinar, When I code like this: from twitterscraper import query_tweets list_of_tweets = query_tweets('HRTechConf', begindate=datetime.date(2019, 9, 26), enddate=datetime.date(2019, 10, 6), lang='en') tweets_df = pd.DataFrame([vars(x) for x in list_of_tweets]) And I...
When trying to pull the attribute is_verified from a non-verified profile using User.query_user_info(), the following error occurs: AttributeError: type object 'User' has no attribute 'is_verified' However, for verified profiles this...