hydropandas icon indicating copy to clipboard operation
hydropandas copied to clipboard

Speed Up API Calls with Concurrent Programming

Open martinvonk opened this issue 1 year ago • 3 comments
trafficstars

I think we should be able to speed the API call's using concurrent programming with Python's standard library package asyncio.

Some information on how to implement this by Arjan: https://www.youtube.com/watch?v=GpqAQxH1Afc

martinvonk avatar Mar 20 '24 08:03 martinvonk

Worth checking out, and hopefully the servers on the other side won't mind more requests per minute :innocent:

dbrakenhoff avatar Mar 20 '24 11:03 dbrakenhoff

Maybe we can start with the BRO API. That's the most modern API so that should work. Additionally, the requests to the BRO are big so concurrent programming should give the most benefit here.

martinvonk avatar Apr 02 '24 11:04 martinvonk