Chuck Daniels
Chuck Daniels
To possibly bypass the memory issue, I've attempted to use kerchunk instead, based upon the [HDF Reference Recipe for CMIP6](https://pangeo-forge.readthedocs.io/en/latest/pangeo_forge_recipes/tutorials/hdf_reference/reference_cmip6.html?highlight=HDF5#hdf-reference-recipe-for-cmip6), but also to no avail: ```python import os from tempfile...
@cisaacstern, thanks for the reply. In the version of the code in my initial description, I've pruned the pattern to only 1 file: ```python # Prune to 1 element to...
Fantastic! Thank you! Yes, at one point I had also run into that `IndexError` you mentioned. I don't recall how. I had also tried larger values for `lat` and `lon`...
Everything is float32, apart from the time values, which are datetime64[ns]. Did you use 8 bytes in the chunk size computation because you were thinking the data are float64, not...
> > Everything is float32, apart from the time values, which are datetime64[ns]. Did you use 8 bytes in the chunk size computation because you were thinking the data are...
I also see a few dozen of these 2 warnings during execution of the recipe: ```plain .../python3.11/site-packages/xarray/core/dataset.py:2461: SerializationWarning: saving variable None with floating point data as an integer dtype without...
Here's the current, successfully running code (running locally, pruned to 2 files), when the server isn't flaking out. I also managed to get a successful local run pruned to 10...
I'd suggest considering [uv](https://github.com/astral-sh/uv). It might not quite be ready for prime-time, but I strongly feel this is worth a look. It's by the [same folks that created ruff](https://github.com/astral-sh/uv), which...
As a follow-on, I know some people love poetry and others hate it. It's difficult to find any sort of tool or library that is nearly universally appreciated, but poetry...
Along with `uv`, [rye](https://rye-up.com/) is another option to consider. Both are implemented in Rust and are blazingly fast at resolving dependencies. As far as I've looked, `rye` appears to be...