h5pyd icon indicating copy to clipboard operation
h5pyd copied to clipboard

hsload inefficient for zero-filled datasets

Open jreadey opened this issue 7 years ago • 0 comments

hsload isn't inspecting chunks prior to writing them to the server. This results in the server needlessly allocated chunks on the server and increased file size.

hsload should inspect each chunk and skip the write if the chunk is all zeros (or whatever the fill value is).

jreadey avatar Aug 09 '17 16:08 jreadey