Andrew Lapp

Results 205 comments of Andrew Lapp

Either you need to manually change `level = logging.INFO` to `level = logging.WARNING` in `ts_logger.py`, or even better, you could change `main.py` so a command line argument can fix it....

@NicholasDow you may have multiple conflicting python installations. I recommend 1) trying this fix https://stackoverflow.com/a/52259845 2) trying to create a virtualenv and install twitterscraper in there

@AllanSCosta a new driver is created for each process in the pool, and each driver is initiated with a unique proxy. This uses FirefoxDriver, but I think ChromeDriver would work...

@AllanSCosta users were having trouble due to twitter dropping their legacy endpoints, see the linked issues.

Oh oops, you're right! I just pushed those changes in misc fixes, reverted!

Fun side note: if you want to see the browsers in actions (or if theres an issue see what's going wrong) allow the browser to be visible by setting `driver.headless...

@AllanSCosta I could not reproduce. I'm able to get 1300 of trumps tweets. Could you try again with latest changes, and set `headless = False`, and tell me if you...

As an aside, it appears that scrolling down on twitter stops after 1300 tweets on `realDonaldTrump`s page. I'll investigate how to continue scrolling. Edit: It appears the non-js query.py only...

https://github.com/taspinar/twitterscraper/pull/304/files appears to fix the main issue. I am going to make js optional here so we can have a backup if/when #304's solution fails.

@AllanSCosta @pumpkinw can you please 1) add `driver.get_screenshot("foo.png")` to this line https://github.com/taspinar/twitterscraper/pull/302/files#diff-83a91a4e1920f0a97f5f9b7c5eabefc5R126 - then share the resulting screenshot 2) share your geckodriver version 3) share your firefox version 4) share...