Rate Limit API Calls

[svenefftinge]

We should add rate limiting so things like this cannot tear the service down.

FWIW here's a tutorial [1]

[akosyakov]

@amvanbaren could you take care about it as well as a follow up to yesterday incident? We could start with something like 15 requests per second.