add support for archive.org twitter search

[hroberts]

add option to create twitter topic using archive.org twitter search instead of crimson hexagon search. compare existing ch-based us 2018 topic with archive.org based topic.

[rahulbot]

Do we know how they are dealing with the tweet deletion problem? Ie. if a user deletes a tweet later does it disappear from achive.org?

[hroberts]

I don't know. But the tweet payload retrieval from then is very slow, so the initial implementation will just use archive.org to get the tweet ids and then fetch the full tweets from twitter, as we do with CH.

On Fri, May 3, 2019 at 10:21 AM rahulbot [email protected] wrote:

Do we know how they are dealing with the tweet deletion problem? Ie. if a user deletes a tweet later does it disappear from achive.org?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_berkmancenter_mediacloud_issues_583-23issuecomment-2D489132442&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=0c5FW2CrwCh84ocLICzUHjcwKK-QMUDy4RRw_n18mMo&m=S_ns7Y0xJ30qA5cRygqqWKR_5QUZAIDfieb3CisSpOE&s=u27EM6wvLeuyJnyR60BFxjHXETpGrpLSOKvO7Cruvu4&e=, or mute the thread https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AAN66T5FLYGHTLO26VO4T23PTRJYNANCNFSM4HJUGVVA&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=0c5FW2CrwCh84ocLICzUHjcwKK-QMUDy4RRw_n18mMo&m=S_ns7Y0xJ30qA5cRygqqWKR_5QUZAIDfieb3CisSpOE&s=2Lem8t_e1qlu6caG7O1Xy4hWtpecrO8JFQYLwYqBkz8&e= .