Baichuan-7B icon indicating copy to clipboard operation
Baichuan-7B copied to clipboard

[Question] 请问继续预训练的loss降到什么水平是合格的

Open parkLGW opened this issue 1 year ago • 0 comments

Required prerequisites

Questions

用自有数据继续预训练,loss一直在2.1左右,请问是正常的吗 image

Checklist

  • [X] I have provided all relevant and necessary information above.
  • [X] I have chosen a suitable title for this issue.

parkLGW avatar Jul 21 '23 09:07 parkLGW