Peter Lindstrom

There are no immediate plans to support half precision, although parts of zfp have been designed to eventually accommodate both half and quad precision. Currently the best workaround is to...

Yes, that's currently the best workaround. Thanks for describing your problem. I'm surprised you're getting only 100 MB/s throughput using zfp. I assume this is for single precision and low-dimensional...

@yunhua-deng, thanks for sharing your data. It appears to be uncorrelated (random) in space, making it not a great candidate for zfp compression. zfp was designed for data that varies...

Part of the reason for the error reduction is that, for a fixed tolerance, zfp increases the precision with dimensionality to meet that tolerance. Part of the reason why storage...

@Falken42 Thanks for your feedback. I'm thinking we could initially add support for half precision to the high-level interface only (not to the C++ compressed arrays). What complicates full support...

Thanks for the pointer. Some of these talks are from colleagues working on LLNL's [Variable Precision Computing](https://computing.llnl.gov/projects/vpc-variable-precision-computing)project. I myself am involved in [development](https://posithub.org/conga/2018/techprogramme) and [standardization efforts](https://posithub.org/docs/posit_standard.pdf) of some of these...

@aras-p Thanks for sharing. We have not tackled fp16 yet for several reasons. First, the way zfp is currently structured, each new data type requires a separate code path for...

@jvo203 Thanks for the suggestion and code. I think this capability is not mmap specific but would be generally useful when the caller has already allocated and initialized a buffer...

@jvo203 You make a good point. We could add a static function that returns the compressed size of an array of given dimensions, scalar type, and rate. Another option is...

I think in principle what you're asking for would be possible via CUDA streams (I must confess to not knowing much about it), but I'm unsure how we would expose...