请问可以用这个框架进行LLM的自监督训练吗？

Open calvinzhan opened this issue 2 years ago • 1 comments

如果我有大量的领域文本，能用LMFlow直接在纯文本上训练吗？也就是直接把纯文本喂给模型。

Apr 24 '23 08:04 calvinzhan

可以的！可以直接将数据整理成text_only格式进行训练

Sure! You can directly organize the data into text_only format for training.

Apr 24 '23 15:04 shizhediao

This issue has been marked as stale because it has not had recent activity. If you think this still needs to be addressed please feel free to reopen this issue. Thanks

May 15 '23 00:05 shizhediao