TART icon indicating copy to clipboard operation
TART copied to clipboard

Use HDF5 for data storage

Open tmolteno opened this issue 6 years ago • 1 comments

The use of python pickle to store Observation and Visibility objects is not a good long term option. This is not robust to python2 vs python3, so persistence will move to HDF5 files.

This will add a dependency to the 'tart' python package (it will depend on h5py). Some routines will need to be written to convert existing files.

  • [x] Write new persistence methods. with tests.
  • [ ] Utilities to convert from pickle to .hdf (written in python2).
  • [x] Update testbenches
  • [x] Web app save HDF RAW files
  • [x] Web app save HDF Vis files

tmolteno avatar Mar 06 '19 08:03 tmolteno

All that is required now is to change the file extension to .hdf in tart_web_api/service.py. Testbenches are done and passing for exporting and importing lists of visibilities into .hdf5 files.

tmolteno avatar Jun 18 '19 10:06 tmolteno