Collect displayed tweets for research purpose

[SjDayg]

As far as I know twitter shutting down its free API has created a lot of challenges collecting tweets for research.

xcancel would be a great source - saving all requested tweets and providing a bulk-download option or a searchable database would be a great (while biased) source for getting a great amount of tweets with little effort. I am thinking about something similar to this: https://academictorrents.com/details/1614740ac8c94505e4ecb9d88be8bed7b6afddd4

(I am not personally heavily invested in this issue. I just thought it would be a great opportunity to enable more research, transparency&accountability around X.)

[pin-grid-array]

If you want to do this, please set up your own private instance and use that instead, not a public one that someone set up out of the kindness of their heart and that is probably already strapped for money.

[SjDayg]

I am not sure if you got me right. I didn't say that I wanted to crawl additional request using public instances. I think there is demand for a feature of saving all the tweets that are already accessed. So there would be some need for storage, true. Besides that I don't see additional needed resource needs.

[zedeus]

Probably not happening, it overlaps with other distributed archive ideas which are not very likely to happen either. If it does happen, it'll solve this automatically.