h5pyd
h5pyd copied to clipboard
hsload inefficient for zero-filled datasets
hsload isn't inspecting chunks prior to writing them to the server. This results in the server needlessly allocated chunks on the server and increased file size.
hsload should inspect each chunk and skip the write if the chunk is all zeros (or whatever the fill value is).