dialogy
dialogy copied to clipboard
Replace XLMR with mDeBERTa-v3
Paper: https://arxiv.org/pdf/2111.09543.pdf
The authors compare XLMR with mDeBERTa-v3, and show that mDeBERTa-v3 is significantly better than XLMR (previous sota) in XNLI dataset.
Changing from XLMR to mDeBERTa-v3 should be trivially easy since it is on huggingface.