Baichuan2 icon indicating copy to clipboard operation
Baichuan2 copied to clipboard

Published 20 hours ago • verified publisher icon baichuan-inc

baichuan2-13B-chat 微调loss 一直为0

Open sunjinguo opened this issue 10 months ago • 2 comments

尝试不同的测试数据, 训练过程中loss 一直为0

sunjinguo avatar Apr 17 '24 08:04 sunjinguo

同样的问题，请问你解决了么

yajunDai avatar Apr 30 '24 02:04 yajunDai

这个问题没解决，换了LLama-Factory 框架微调了，然后测试的baichuan2 跟qianwen1.5

------------------ 原始邮件 ------------------ 发件人: "baichuan-inc/Baichuan2" @.>; 发送时间: 2024年4月30日(星期二) 上午10:23 @.>; @.@.>; 主题: Re: [baichuan-inc/Baichuan2] baichuan2-13B-chat 微调loss 一直为0 (Issue #401)

同样的问题，请问你解决了么

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

sunjinguo avatar May 15 '24 01:05 sunjinguo