Pretrained-Language-Model icon indicating copy to clipboard operation
Pretrained-Language-Model copied to clipboard

How does BinaryBERT store the 1 bit weight?

Open jzhang38 opened this issue 2 years ago • 0 comments

May I ask how BinaryBERT stores the 1-bit weights on GPU memory? Are they stored as (native) 1 bit on the GPU memory or as 8-bit integer?

jzhang38 avatar May 08 '23 16:05 jzhang38