Einsums
Feature: Ideas for out-of-core tensors
Dr. Turney and I have talked about moving away from HDF5 for disk operations. I wanted to see what kinds of ideas other people had for this kind of a thing. We can also discuss on the Discord server if here is not a good place.
For my piece, I think staying with HDF5 wouldn't be bad, but I would like to get rid of the h5cpp layer and use the official HDF5 C++ wrapper.
Yeah that's fine with me. I used h5cpp because it did some stuff automatically for me. Reducing the number of dependencies einsums has is always good.
We just need to really document how to tune hdf5 for get reasonable performance. It's really easy to get terrible performance from it.
I'll look into what needs to be done. I think it may make tiled tensors and block tensors easy to handle, though.