DeBERTa icon indicating copy to clipboard operation
DeBERTa copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

DebertaV3: is EMD used in generator and discriminator?

Open stevenliu000 opened this issue 2 years ago • 0 comments

Impressed by the performance debertaV3, and I'm trying to re-produce debertaV3.

I have a question regarding the model architecture in DebertaV3. Is EMD used in generator when doing MLM task? I see the released code for ReplacedTokenDetectionModel and it seems that Discriminator does not use EMD. Can you comfirm that?

Thanks!

stevenliu000 avatar Mar 03 '22 07:03 stevenliu000