model-optimization icon indicating copy to clipboard operation
model-optimization copied to clipboard

Add DRIVE tensor encoder

Open amitport opened this issue 4 years ago • 0 comments

Adapted from the source published with "DRIVE: One-bit Distributed Mean Estimation" (NeurIPS '21; https://arxiv.org/pdf/2105.08339.pdf), and the algorithm presented therein.

Without going into the details of the paper, the key reason to include this as a core encoder is that for practical distributed scenarios, this encoder achieves accuracy results that are the same as using float32 while using only one bit per coordinate.

amitport avatar Dec 29 '21 08:12 amitport