gpt-2-output-dataset icon indicating copy to clipboard operation
gpt-2-output-dataset copied to clipboard

Published 20 hours ago • verified publisher icon openai

why Roberta?

Open fatemeh-sh264 opened this issue 5 years ago • 1 comments
trafficstars

Why did you use Roberta and not use BERT or ELMO instead?

fatemeh-sh264 avatar Jul 22 '20 07:07 fatemeh-sh264

In an ablation study (that we didn't publish) we found that RoBERTa fine-tunes better than BERT or GPT-2 itself. We expect ELECTRA should work as well.

jongwook avatar Jul 22 '20 18:07 jongwook