heat icon indicating copy to clipboard operation
heat copied to clipboard

Support `savez`/`savez_compressed` and loading NpzFiles

Open ClaudiaComito opened this issue 2 years ago • 1 comments

Any chance for supporting savez/savez_compressed and loading NpzFiles?

Originally posted by @fschlimb in https://github.com/helmholtz-analytics/heat/issues/101#issuecomment-843967591

References:

  • https://numpy.org/doc/stable/reference/generated/numpy.savez.html
  • https://numpy.org/doc/stable/reference/generated/numpy.savez_compressed.html

ClaudiaComito avatar Apr 01 '22 08:04 ClaudiaComito

@ClaudiaComito I would like to work on this one.

Dhruv454000 avatar Apr 01 '22 11:04 Dhruv454000

Since .npz-format is not an HPC-typical format, it does not make sense from my point of view, to save DNDarray's that really need distribution in this format. On the other hand, for DNDarrays's that are sufficiently small to admit conversion to a non-distributed numpy-array, its easy to use this conversion and to save as .npz afterwards.

Therefore, closed within #1109

mrfh92 avatar Aug 17 '23 12:08 mrfh92