neurolib icon indicating copy to clipboard operation
neurolib copied to clipboard

Published 20 hours ago • verified publisher icon neurolib-dev

autochunk: option to save all simulated data to disk

Open caglorithm opened this issue 4 years ago • 2 comments

WIP, maybe netcdf?

caglorithm avatar Feb 16 '21 11:02 caglorithm

yes, that would be doable.. xarray supports saving to netcdf with a option, which is append. AFAIK, each chunk would be saved with correct time dimension with a option, and this would result in one big nc file with stitched chunks

jajcayn avatar Feb 16 '21 11:02 jajcayn

Another option would be storing into HDF files btw. Will also consider it, but xarray is nice because its structured and probably more flexible.

I guess I'll get my hands dirty with xarray & netcdf then and ask for your help :)

caglorithm avatar Feb 16 '21 12:02 caglorithm