twint icon indicating copy to clipboard operation
twint copied to clipboard

Search just stops scraping

Open ervinflx opened this issue 2 years ago • 14 comments

Hello I'm currently using twint in Powershell from anaconda. My python version is 3.6 and I've updated twint just yesterday with pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint . I have a problem right now. I' using this code twint -s "pinches hondureños" --since 2018-10-22 -o file.json --json. At first it shows me some tweets that have been made in the past days, but it just stops and says the following: [!] No more data! Scraping will stop now. found 0 deleted tweets in this search. I know that there are more tweets with that phrase, but twint does not collect them, has anyone had this problem before? And if you had, How did you resolve it? Thank you

ervinflx avatar Mar 04 '22 20:03 ervinflx

Hi @ervinflx inspired by @minamotorin and others I made some changes please check https://github.com/woluxwolu/twint/tree/woluxwolu-update0308

woluxwolu avatar Mar 08 '22 09:03 woluxwolu

@woluxwolu Thank you so much, I am just trying to work out this issue, and it is magically successful with your code!!!!

Huo-Yuan avatar Mar 08 '22 14:03 Huo-Yuan

@woluxwolu Thank you so much, I am just trying to work out this issue, and it is magically successful with your code!!!!

ur welcome

woluxwolu avatar Mar 08 '22 14:03 woluxwolu

Hello I meet the same problem likes this, when I want to get the tweets before 2022-03-01, it will say[!] No more data! Scraping will stop now. found 0 deleted tweets in this search. I saw that you say you have made some change and maybe can solve this problem. However, I am a beginner of using github, I do not know where to see your change. Can you please get me some guide to solve this problem? Thank you~

zwjcrilde avatar Mar 09 '22 19:03 zwjcrilde

Hello I meet the same problem likes this, when I want to get the tweets before 2022-03-01, it will say[!] No more data! Scraping will stop now. found 0 deleted tweets in this search. I saw that you say you have made some change and maybe can solve this problem. However, I am a beginner of using github, I do not know where to see your change. Can you please get me some guide to solve this problem? Thank you~

Reinstall your twint using this fork: !pip install git+https://github.com/woluxwolu/twint.git

woluxwolu avatar Mar 09 '22 23:03 woluxwolu

Hello I meet the same problem likes this, when I want to get the tweets before 2022-03-01, it will say[!] No more data! Scraping will stop now. found 0 deleted tweets in this search. I saw that you say you have made some change and maybe can solve this problem. However, I am a beginner of using github, I do not know where to see your change. Can you please get me some guide to solve this problem? Thank you~

Reinstall your twint using this fork: !pip install git+https://github.com/woluxwolu/twint.git

Thank you very much!

zwjcrilde avatar Mar 10 '22 06:03 zwjcrilde

Hi @ervinflx inspired by @minamotorin and others I made some changes please check https://github.com/woluxwolu/twint/tree/woluxwolu-update0308

Brilliant! Thank you for fixing this 🎉

batmanscode avatar Mar 13 '22 08:03 batmanscode

Hi @woluxwolu, I just tired to get more history tweets, but it only seems return data for the past week. My python version is 3.6 and run on Windows. Do you have any solutions about this? Thank you very much!

vgewilliam avatar Mar 16 '22 10:03 vgewilliam

Hi @woluxwolu, I just tired to get more history tweets, but it only seems return data for the past week. My python version is 3.6 and run on Windows. Do you have any solutions about this? Thank you very much!

In case it was overlooked, make sure you've uninstalled the previous version of twint

batmanscode avatar Mar 18 '22 13:03 batmanscode

Hi @woluxwolu, I just tired to get more history tweets, but it only seems return data for the past week. My python version is 3.6 and run on Windows. Do you have any solutions about this? Thank you very much!

In case it was overlooked, make sure you've uninstalled the previous version of twint

Hello, @batmanscode , thank you for your answer, perfect!!!Now, it working!

vgewilliam avatar Mar 18 '22 14:03 vgewilliam

Glad to hear @vgewilliam. Happy scraping! 😀

batmanscode avatar Mar 18 '22 14:03 batmanscode

Glad to hear @vgewilliam. Happy scraping! 😀

Hello @batmanscode, I would like to ask if it is possible to get tweets with geolocation?? c.location seems does not work?

vgewilliam avatar Mar 22 '22 09:03 vgewilliam

Glad to hear @vgewilliam. Happy scraping! 😀

Hello @batmanscode, I would like to ask if it is possible to get tweets with geolocation?? c.location seems does not work?

I'm not sure. That's how I would expect that to work since it's in the wiki but unfortunately some things are broken :(

Try c.Geo or c.Near instead, maybe that will work

batmanscode avatar Mar 22 '22 12:03 batmanscode

Hi @ervinflx inspired by @minamotorin and others I made some changes please check https://github.com/woluxwolu/twint/tree/woluxwolu-update0308

I have been looking for this for like the past whole week and I'm so glad I finally came to a solution!!! I just simply can't express how much I'm grateful for your help. THANKS!!

Wigzart avatar Apr 06 '22 07:04 Wigzart