cdsapi icon indicating copy to clipboard operation
cdsapi copied to clipboard

Best practices when sending multiple requests

Open AlFontal opened this issue 4 years ago • 0 comments

As it stands now, I usually make several requests to split in chunks the datasets I fetch through the API for less memory-intensive processing.

However, there is no way to send a list of requests (I am just using for loops to do so now) and my requests usually take ~20 min in queue and 1-2 min downloading, which makes fetching the datasets a quite time-consuming process.

Is there any way to speed this up?

AlFontal avatar May 26 '21 13:05 AlFontal