download-tweets-ai-text-gen icon indicating copy to clipboard operation
download-tweets-ai-text-gen copied to clipboard

Scrape from list

Open wradd opened this issue 4 years ago • 1 comments

I've been using your Collab notebook and your blog post about building a text-generating Twitter bot with GPT-2. I would like to train a bot on tweets from an entire Twitter list, as opposed to a single user.

Twint supports scraping a list but doesn't remove replies like this script does, and that's important as you point out in your blog post.

Ideally, a user of this script could use something like this:

python3 download_tweets.py <twitter_list_URL>

This is my first issue or feature request. Very open to feedback!

wradd avatar Feb 28 '20 03:02 wradd

The script has been updated to include the ability to scrape tweets from multiple accounts, which are listed in a text file. It isn't as turnkey as your recommendation, but now, you don't have to scrape each Twitter account independently.

sdelgadoc avatar Apr 12 '20 01:04 sdelgadoc