MobileBert_PyTorch
MobileBert_PyTorch copied to clipboard
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Finetune on sts-b & sst-2 task, the result is poor。 The parameters is not changed, And turn the epoch to 50; Eval Result: colo: 0 sst-2(acc) : 0.8 sts-b(pearson) :...
@lonePatient great work! A simple question, is it possible train from scratch with your code? Thanks in advance!
Hi, Thank you for sharing your work! Do you have results on Squad 1.0? What parameters should it be? Best, ZLK