[Help] <How to continue pre-training and fine-tuning？>

[acadaiaca]

ChatGLM how to continue pre-training and fine-tuning？

This is the same question in this issue: https://github.com/THUDM/ChatGLM-6B/issues/3 But after reading these information I still don't know how to use HF trainer to train or finetune ChatGLM-6B.

Has anyone successfully implemented it?

[acadaiaca]

能否用GLM的pretrain代码和finetune代码来做CahtGLM的continue pretrain和finetune？ https://github.com/THUDM/GLM/blob/main/pretrain_glm.py https://github.com/THUDM/GLM/blob/main/finetune_glm.py

[clm971910]

哪位同学做过 ，求代码

[duzx16]

Already supported now. https://github.com/THUDM/ChatGLM-6B/tree/main/ptuning

[cxjtju]

哪位同学做过 ，求代码

请问同学找到解决办法了吗