[Question] Why is Twint not extracting tweets?

[Barbz2]

trafficstars

Hi,

I am trying to extract tweets in England, under the query of 'hate speech'.

I wrote the following code:

---

import twint

c = twint.Config()

c.Username = "noneprivacy" c.Custom["tweet"] = ["id"] c.Custom["user"] = ["bio"] c.Limit = 10 c.Geocode = 'England' c.Store_csv = True c.Output = "none"

twint.run.Search(c)

---

The output was: Results: #[!] No more data! Scraping will stop now. #found 0 deleted tweets in this search.

I tried using the previous code as an experiment before searching my own query. I also added a date limit but it makes no difference. It was working well yesterday but for whatever reason, it has stopped. I can't seem to get why Twint is not working right now. Any advice?

Python - 3.8.5 Windows 10 Notepad ++

Thank you so much! :)

[minamotorin]

Same as #1349

[Barbz2]

I have tried the solution but it is not working. I even tested the examples the comments provided under #1349 but it is not working for me.

[vgewilliam]

Maybe you should update "pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint"?

[minamotorin]

@Barbz2

#1349 means you have to use twint.run.Profile instead of twint.run.Search. Have you tried this?

[Barbz2]

Hi,

No, it gives me a different error message. That said an old coding program has started working, so I will try and go with that (until it stops again) :)

Thank you for your help!

On Wed, 16 Mar 2022 at 04:58, minamotorin @.***> wrote:

@Barbz2 https://github.com/Barbz2

#1349 https://github.com/twintproject/twint/issues/1349 means you have to use twint.run.Profile instead of twint.run.Search. Have you tried this?

— Reply to this email directly, view it on GitHub https://github.com/twintproject/twint/issues/1370#issuecomment-1068733033, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQ34Y2DY7HRV7ACZUIZWM5LVAFS6FANCNFSM5QZAJDTQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

[orestisc]

@Barbz2

#1349 means you have to use twint.run.Profile instead of twint.run.Search. Have you tried this?

Experiencing the same problem, tried everything. twint.run.Profile returns error: json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

EDIT : twint.run.Search works fully sometimes. Other times getting half data Most of the time showing #[!] No more data! Scraping will stop now. #found 0 deleted tweets in this search.

[woluxwolu]

Maybe you can check here #1363 OR Just Reinstall your twint using this fork: !pip install git+https://github.com/woluxwolu/twint.git

[batmanscode]

@woluxwolu's fork works for me. I was able to scrape tweets going back years

[YooTimmy]

Hello,

I am having similar issues (seeing the following returns while running the queries) #[!] No more data! Scraping will stop now. #found 0 deleted tweets in this search.

Have tried the solution proposed by woluxwolu to reinstall my twint, but problem still exists. Any suggestions would be appreciated.

[vgewilliam]

Hello,

I am having similar issues (seeing the following returns while running the queries) #[!] No more data! Scraping will stop now. #found 0 deleted tweets in this search.

Have tried the solution proposed by woluxwolu to reinstall my twint, but problem still exists. Any suggestions would be appreciated.

Hello @YooTimmy , maybe you can try uninstall the twint first and then reinstall: !pip install git+https://github.com/woluxwolu/twint.git.

[YooTimmy]

Hello @YooTimmy , maybe you can try uninstall the twint first and then reinstall:

Thanks for getting back! I have tried uninstall (pip uninstall twint is the code I used, it rans successfully) and then install using your command again. But still, when extracting the tweets it will stop in the middle or only return a few hundred records back.

[ghost]

The fork works. You are lucky to find anything that works on Windows lately.

[pbabvey]

Thanks, @woluxwolu for the fix. It works to download tweets. I am still getting errors while using twint to collect the following/follower lists. Is there a solution around that or a hint on how can we fix it?