Jason Michael Baumgartner

At the very least, I think a good first step would be to create a basic "auth pool" from which Tweepy can switch between when a rate limit is reached...

Thanks. I'm reviewing the API documentation now. Data ingest is my specialty. :) When you import the module and instantiate an instance, I'm assuming it would make sense for us...

> I'm not sure what to do for the url field. I don't think the api will return a public url, but maybe you can figure out how to construct...

My only concern here is that if you want the script to collect all available stories from the feed and don't supply any type of minimum date, there is a...

I've set up a simple class to make API calls to the AP. I fetched one item from the feed. The fields returned are below. There is a uri returned...

The code is working well. Here is an example of the output it produces (it will give a list, but this is an example of one of the dicts within...

I did a lot of testing of the code yesterday and noticed a few minor issues. Occasionally, a story will have no url associated with it (these stories appear to...

Pull request for new code and the added associated_press section in the config file. https://github.com/berkmancenter/mediacloud/pull/588

I fixed a minor issue with a line of code that should have been removed with the last commit. Tested locally and it works well and appears to handle all...

From my preliminary review of the search endpoint, it looks very robust and appears capable of doing exactly what we need to ingest more history if needed. I'm comparing it...