Brian Blaylock
Brian Blaylock
> I was able to download multiple byte ranges with a single request. If that's possible with curl, that would be a huge improvement in speed! This is a good...
Kerchunk has the ability to "scan" a file and determine the byte ranges for each message without downloading the file. - https://github.com/fsspec/kerchunk/blob/f272c66c9ea23dd8aaef885f9b6fb1c1312d3813/kerchunk/grib2.py#L91 - https://nbviewer.org/gist/peterm790/92eb1df3d58ba41d3411f8a840be2452 I was able to get the...
Thanks for reporting this! I can't promise I will have time to dig into this soon, but I can reproduce the error. Looks like something in how Herbie is using...
I rewrote this xarray accessor and named it `pick_points`, which resolves this issue. In Herbie version 2024.5.0, you can now do this to get value at two different points... ```python...
That's interesting. Herbie doesn't limit downloads, but Amazon might impose limits I'm not aware of, or your server is timing out. You might need to download data in chunks. If...
This is great feedback. Can you share more about how you are doing a download? I'm not sure where the memory is going when creating Herbie objects. Actually...now that I...
Thanks for sharing this. Yes, FastHerbie could use some improvements.
This would be a good feature to add. Just need to know how to check for this error before moving on. In the mean time, I believe you can change...
This could be worked on as part of #172
I will need to look for the file path from the cfgrib history ```python import re import xarray as xr ds = xr.open_dataset(FILE, engine='cfgrib') match = re.search(r'"source": "(.*?)"', ds. History)...