devsjc

Results 22 comments of devsjc
trafficstars

```python load_everything_into_ram( pv_power_filename, pv_metadata_filename, ... ) ``` pv_power_filename is referring to the netcdf file is it?

So once loaded in, all the data from each individual country's `.netcdf` file, and the system metadata for all the systems in that country, are all joined together and fully...

That makes sense. And in the end these `.netcdf` files are read in using xarray to a ~~pandas dataframe~~ xarray DataArray, which is the final form in which the data...

All data has been loaded onto Leonardo, at `/mnt/storage_ssd_4tb/PVOutput`.

@jacobbieker Apologies for the delay - yes, this sounds like a valuable improvement! I'm assuming the NASA satellite would require the same kind of processing chain as is already present...

## 2024-04-29 Conversion is still ongoing.

Not a backfill I was aware of, was probably being run via Jacobs login on a VM so not something I can easily track - going off of Peter's described...

@JackKelly I have been able to load a wholesale file with a bit of faffing. Firstly, splitting the file up into a grib file per parameter with the following command:...

It actually seems like the necessary change to the `check_range` function in `_load_convert.py` has already been made last year: https://github.com/SciTools/iris-grib/pull/296/files - but there hasn't been a new release of the...

Ah that's useful to know, thanks! I didn't realise mounted volumes came under the potential data parts up for deletion during a reset. The docs `reset.md` says the main data...