ChatGLM-6B icon indicating copy to clipboard operation
ChatGLM-6B copied to clipboard

Published 20 hours ago • verified publisher icon THUDM

如何在领域数据上二次预训练

Open ZTurboX opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

No response

Solutions

如何在领域数据上二次预训练

Additional context

No response

ZTurboX avatar Jun 02 '23 00:06 ZTurboX

我也在做增量预训练，欢迎做类似的伙伴交流

MikeHollyWong avatar Jun 02 '23 02:06 MikeHollyWong

正准备做这个事情，大家有什么推荐的方案吗？

feisan avatar Jun 06 '23 22:06 feisan

插眼

ghost avatar Jun 07 '23 03:06 ghost

现在有结果吗

greatheart1000 avatar Jun 08 '23 03:06 greatheart1000

cy

SolarKnight1 avatar Jun 08 '23 03:06 SolarKnight1

看来官方暂时不太打算回答这方面的问题。

我准备按照这个项目来搞一搞 https://github.com/shibing624/MedicalGPT

feisan avatar Jun 14 '23 15:06 feisan

https://github.com/shibing624/MedicalGPT 参考这个项目，预训练，指令微调，rm模型训练，ppo都有现成的

tomcat123a avatar Jul 20 '23 03:07 tomcat123a