BiBERT icon indicating copy to clipboard operation
BiBERT copied to clipboard

Published 20 hours ago • verified publisher icon htqin

Was Two Stage Knowledge Distillation used as in BinaryBERT?

Open Phuoc-Hoan-Le opened this issue 1 year ago • 0 comments

Was Two Stage Knowledge Distillation used as in BinaryBERT in Table 7 (https://arxiv.org/pdf/2012.15701.pdf) to get these results?

Phuoc-Hoan-Le avatar Feb 26 '23 20:02 Phuoc-Hoan-Le