weather-provider-api icon indicating copy to clipboard operation
weather-provider-api copied to clipboard

WPLA 2.x\\ BUG - ERA5 Land model downloading limit

Open rflinnenbank opened this issue 1 year ago • 0 comments

When downloading for the ERA5 Land repository, it will hit a 1000 item download limit. Because a single factor for a full month already amounts to a 744 item count, this means that in no way it would be possible to download this dataset in a single file per month.

Intended fix: The safest way to fix this is by downloading on a per factor basis. As every factor individually can't overstep the 1000 item count, this would work regardless of the number of factors downloaded, whereas downloading on a "per ... days" basis could theoretically overstep this limit when increasing the number of factors to support in the future.

As such the intended solution is:

  • Download months per factor.
  • Merge the factors together
  • Store the month

rflinnenbank avatar Feb 01 '23 08:02 rflinnenbank