torchdatasets icon indicating copy to clipboard operation
torchdatasets copied to clipboard

Published 20 hours ago • verified publisher icon szymonmaszke

HDF5 Support

Open bearpaw opened this issue 3 years ago • 1 comments

Thanks for this amazing library. I was wondering for large datasets with millions of images, would it make sense to cache in a single file (e.g., HDF5) instead of creating millions of cache files? Do you have any plan to support Hdf5 format? Thanks!

bearpaw avatar Sep 23 '20 23:09 bearpaw

Will check out HDF5 and other formats and update for upcoming 0.3.0 release. If you have any suggestions feel free to post, thanks.

szymonmaszke avatar Sep 26 '20 15:09 szymonmaszke