backend
backend copied to clipboard
mediacloud
plugin to discover content from FB (via CrowdTangle)
We've decided that we can retrieve a useful set of content from CrowdTangle, so we need to add a plugin that lets us discover and ingest content via their API while creating a topic. This should look a lot like #598, but using the CrowdTangle API.
@hroberts can advise on a Berkman Klein colleague to ping about the best endpoints to use. I can provide an API key through a different channel.
Open questions:
- what is our rate limit on CrowdTangle?
- do we want to download the top N or some other kind of sample?
- what sort order makes sense here? (options: date, interaction_rate, overperforming, total_interactions, underperforming)
I don't know our rate limit. Bruce has been able to use his key to just get every post matching a given query. We should try to do that.
-hal
On Tue, Oct 1, 2019 at 9:58 AM rahulbot [email protected] wrote:
Open questions:
- what is our rate limit on CrowdTangle?
- do we want to download the top N or some other kind of sample?
- what sort order makes sense here? (options https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_CrowdTangle_API_wiki_Search&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=0c5FW2CrwCh84ocLICzUHjcwKK-QMUDy4RRw_n18mMo&m=0cKxKpWdtXnAIbqCzOFIJWEbft1Exk50SnYG07r3j9o&s=tY7QrN4EsrOvC1Xe_r9jwEmSDeAOs08WiAACPfUu0pM&e=: date, interaction_rate, overperforming, total_interactions, underperforming)
— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_berkmancenter_mediacloud_issues_611-3Femail-5Fsource-3Dnotifications-26email-5Ftoken-3DAAN66T3ER5WK5ZJDQSQ47I3QMNQQZA5CNFSM4I4C6LZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEABSIMQ-23issuecomment-2D537076786&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=0c5FW2CrwCh84ocLICzUHjcwKK-QMUDy4RRw_n18mMo&m=0cKxKpWdtXnAIbqCzOFIJWEbft1Exk50SnYG07r3j9o&s=46cCfF8OtgS_f8Ya3M7_oSzYd4gu9UoITTCYdxU6erk&e=, or mute the thread https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AAN66T5JGVNTQPJHGNYT4KLQMNQQZANCNFSM4I4C6LZQ&d=DwMCaQ&c=WO-RGvefibhHBZq3fL85hQ&r=0c5FW2CrwCh84ocLICzUHjcwKK-QMUDy4RRw_n18mMo&m=0cKxKpWdtXnAIbqCzOFIJWEbft1Exk50SnYG07r3j9o&s=nILlGI0qU0GvMk67KQhm7x8yQnkNuG3oqZpNbfra-yg&e= .
I'm on a "dashboard" and can see my own API key. When we get to this I can invite you, or have Fernando do that, and see what happens (hopefully you'll get in and be able to see a key). This raises the obvious question of whose key you should use when we get to production integration... but we can handle that if/when we get there.
Yeah, we use LastPass for many of our keys. Send me your Facebook account and I'll see if I can add you to our CrowdTangle team. Failing that I'll share my key.
Rahul,
Sorry missed the alert for your last message. I actually deleted my Facebook account a while ago. Can you share your key for the time being? If I need to create an account I can do that but it may be easier to share yours.