fairseq2
fairseq2 copied to clipboard
Downstream w2v-BERT improvements from SC
Port the architectural changes we introduced to w2v-BERT in seamless_communication to fairseq2 for this year's representation learning tasks. Also make sure that we not only support eval, but pretraining as well.