Aaron Gonzales

Results 9 comments of Aaron Gonzales

I am scraping a lot of data each run per day around a large area and #686 did not solve my issue. It would not restart once i hit the...

Judging by the rate of tweets collected, Using a large time break like 420 or 300 is much slower (more than 2x slower) than just using a random sleep timer...

@give-me-data Hope this works well because if so then this would definitely be the fastest method up to this point! good luck!

@jomorrcode actually you are right, I was under the impression that for each query the result returns 200 tweets, but after looking at it again, it is only 20. Since...

Yea plus my init assumption was wrong haha, but for now, the 420 wait limit should be implemented as the standard. Suggest a PR maybe?

A hardcoded timer is definitely not the answer, it should just be an adjustable parameter. With the default value of 420. If twitter changes it then simply adjusting the default...

@pielco11 If it is possible, can I be added? I am going to be using this project for a while for work and will make improvements where and when I...

@wuqui the error is unavoidable when you are scraping a large amount. The only thing we can do is ensure the smallest wait times once Twitter blocks our IP for...

I am experiencing a similar issue on a private repo as well. I will try your fix @rucciva and see if it works. I can provide the packages I am...