kerchunk
kerchunk copied to clipboard
fletcher32 checksum
All datasets with fletcher32 == True are rejected by referenceMaker. This is the checksum supported by HDF5. Would it be possible to add it to nomcodecs? @ajelenak
I think so. numcodecs already supports Adler32 which is similar to Flether32, I think.
The code looks simple enough.
The question is, how is this value included in the target bytes? Is it just in metadata around the bytes? If yes, then we can already ignore the checksum and use the bytes; but implementing the function above would enable the (optional) validation.
Example code of how to fetch the checksums: https://forum.hdfgroup.org/t/accessing-fletcher32-checksum/7299/3
Apparently it's just the last 4 bytes of the given block. So to ignore, we can just truncate.