finetune-transformer-lm icon indicating copy to clipboard operation
finetune-transformer-lm copied to clipboard

how could i train the language with chinese

Open wykdg opened this issue 7 years ago • 3 comments

how could i train the language with chinese ,but the code only shows how to finetune the model. thanks

wykdg avatar Aug 14 '18 07:08 wykdg

Me too. I need the way how to finetune the model with the other language. Can you share how to pretrain the model? Thank you in advance.

youngkyung avatar Aug 14 '18 08:08 youngkyung

use the lm_loss as the optimization target.

xuy2 avatar Aug 23 '18 21:08 xuy2

how could i train the language with chinese ,but the code only shows how to finetune the model. thanks

same question.

tomeasure avatar Apr 04 '19 08:04 tomeasure