MobileBert_PyTorch icon indicating copy to clipboard operation
MobileBert_PyTorch copied to clipboard

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

Results 3 MobileBert_PyTorch issues
Sort by recently updated
recently updated
newest added

Finetune on sts-b & sst-2 task, the result is poor。 The parameters is not changed, And turn the epoch to 50; Eval Result: colo: 0 sst-2(acc) : 0.8 sts-b(pearson) :...

@lonePatient great work! A simple question, is it possible train from scratch with your code? Thanks in advance!

Hi, Thank you for sharing your work! Do you have results on Squad 1.0? What parameters should it be? Best, ZLK