transformers
transformers copied to clipboard
Can I replace the nsp task with sop in the pre-training task of bert
in the notebook -"Training With MLM and NSP",can I replace the nsp task with sop in the pre-training task of bert? If so, how to achieve it, please point out the big brother! Thanks!