PyPRECIS icon indicating copy to clipboard operation
PyPRECIS copied to clipboard

Rationalise & organise data for notebooks

Open hsteptoe opened this issue 5 years ago • 2 comments

The data directory associated with the notebooks /project/precis/worksheets/data needs rationalising. The aim is to eventually add this to the github repo via git Large File Store (git lfs) so the smaller we can make it the better.

Some things to check:

  • [x] Do we need pmsl model data? (Double check it isn't used in any of the exercises)
  • [ ] CRU data is the largest single dataset. Can we reduce the size? Do we need to the entire dataset? Can we reduce the area?
  • [ ] Would separate directories for variables be better than separate directories for experiments?
  • [ ] Improve the data processing workflow so that we don't save rim removed nc versions of each individual pp file. I can't see any good reason for doing this - relates to comments in #23

hsteptoe avatar Nov 07 '18 09:11 hsteptoe