cosima-cookbook
cosima-cookbook copied to clipboard
COSIMA
Framework for indexing and querying ocean-sea ice model output.
Hi, I have just fixed a small issue with python 3.10. Note that it is unclear to me whether the default value for the dropdown selector should be `None` or...
Just copying this from [Slack](https://arccss.slack.com/archives/C6PP0GU9Y/p1658895584112989) so we don't lose it: Some of the BGC output in [IAF cycle 4](https://github.com/COSIMA/01deg_jra55_iaf/issues/11) is saved as one time level per file. In these cases...
The time it takes to load the Database Explorer seems to have increased quite markedly recently. ```python import cosima_cookbook as cc session = cc.database.create_session(db='/g/data/ik11/databases/cosima_master_2022-07-01.db') %%time from cosima_cookbook import explore dbx...
A dedicated indexing script has a number of advantages: - Implement complicated logic for optimising indexing, without having to alter the basic API which is ill suited for this task...
The conda package build is currently done on CircleCI https://app.circleci.com/pipelines/github/COSIMA/cosima-cookbook?filter=all The configuration is contained here https://github.com/COSIMA/cosima-cookbook/blob/master/.circleci/config.yml For ease of administration the conda package build should be moved to Github Actions.
It would be good to have a mechanism to uniquely identify (hash) grids for a number of reasons: 1. Disambiguate data that are are in most other ways the same,...
Someone (can't recall who, maybe @AndyHoggANU ?) thought it would be fine, dandy **and** lovely to expose the DB via a web interface. To allow non-NCI users to browse the...
There is an interesting approach which exposes `netCDF4` files as a zarr-like dataset, doing direct reads from the file, bypassing `netCDF`/`HDF5` libraries completely: https://medium.com/pangeo/fake-it-until-you-make-it-reading-goes-netcdf4-data-on-aws-s3-as-zarr-for-rapid-data-access-61e33f8fe685 This leads to extremely good speed-ups:...
Change to `xarray` for indexing to allow support for more file formats. `xarray.open_dataset` for indexing would supports more file formats, particularly `zarr`, `grib` and UKMO `pp` files (via Iris). Would...
When `cc.querying.getvar` attempts to read data from an inaccessible location it gives a non-obvious error ```python ValueError: did not find a match in any of xarray's currently installed IO backends...