ChatGLM-Tuning icon indicating copy to clipboard operation
ChatGLM-Tuning copied to clipboard

Published 20 hours ago • verified publisher icon mymusise

output中存下的checkpoint怎么用

Open EnghishYang opened this issue 1 year ago • 1 comments

请问微调时候，Trainer存下的checkpoints是没用吗？要等所有数据微调完才能存lora.pt去微调吗

EnghishYang avatar Mar 21 '23 01:03 EnghishYang

Trainer下的checkpoints可以保存模型训练梯度的中间态，然后用Trainer(resume_from_checkpoint=True)load ckpt继续训练的，也可以ld后调用保存pt文件

ChangjianZhao avatar Mar 21 '23 11:03 ChangjianZhao

好的

EnghishYang avatar Mar 23 '23 00:03 EnghishYang