MOSS icon indicating copy to clipboard operation
MOSS copied to clipboard
verified publisher icon OpenMOSS

how to continue pretrain?

Open h-ccc opened this issue 2 years ago • 0 comments

Thanks for your wonderful work. The bottle-neck of MOSS may lie in datasets used in the pretrain phase. We want to continue pretrain MOSS on multi datasets like 悟道, Wikipedia and so on. Is there any way to continue pretrain? Thanks in advance!

h-ccc avatar Aug 29 '23 03:08 h-ccc