Daniel Westwood

Results 17 comments of Daniel Westwood

I think this set of NetCDFs just has an extra string field for the date (which is unnecessary but still something that the data provider included). The actual files look...

The file might be accessible at https://data.ceda.ac.uk/badc/ukcp18/data/land-rcm/uk/12km/rcp85/01/huss/day/v20190731/huss_rcp85_land-rcm_uk_12km_01_day_19801201-19901130.nc if you want to try converting this file?

No problem, this isn't particularly time-sensitive for me at the moment. Thanks for taking the time!

I've done some performance testing for Kerchunk vs something the NCAS-CMS team have developed called CFA, and I've discovered something interesting about the Xarray-Kerchunk engine compared to the old get_mapper/open_zarr...

I'm running individual cells in a Jupyter notebook to obtain the different values for those different sections: ``` %%time import xarray as xr kfile = 'example_CMIP_file.json' ds = xr.open_dataset(kfile, engine='kerchunk')...

[example_CMIP_file.json.zip](https://github.com/user-attachments/files/16349802/example_CMIP_file.json.zip) Uncompressed this file is 64MB, I can probably make a smaller version if needed. This file has https:// links now so you should have no issues with accessing the...

> For reference, the kerchunk backend essentially does > > ```python > m = fsspec.get_mapper("reference://", fo=filename_or_obj, **storage_options) > return xr.open_dataset(m, engine="zarr", consolidated=False, **open_dataset_options) > ``` > > Are you passing...

For reference, the CFA conventions/specification can be found here: https://github.com/NCAS-CMS/cfa-conventions/blob/main/source/cfa.md and my developing implementation is here: https://github.com/dwest77a/CFAPyX My module is just the CFA reader backend for Xarray which reads CFA-netCDF...

FYI the variable `h1` that I used to store the result of the sel/slice/mean operations includes a `data` variable that contains the sliced data. I may be wrong in my...

With the use of get_mapper/open_zarr instead, the object `h1.data` is a `dask.array