Linly icon indicating copy to clipboard operation
Linly copied to clipboard
verified publisher icon CVI-SZU

请问在指令微调时损失函数与预训练有什么区别吗

Open dazhaxie0526 opened this issue 2 years ago • 0 comments

请问在指令微调时损失函数与预训练有什么区别吗？指令微调也是根据前文预测下一个token的概率吗？

dazhaxie0526 avatar Jul 04 '23 09:07 dazhaxie0526