Baichuan-7B
Baichuan-7B copied to clipboard
[Question] 请问继续预训练的loss降到什么水平是合格的
Required prerequisites
- [X] I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
- [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
- [X] Consider asking first in a Discussion.
Questions
用自有数据继续预训练,loss一直在2.1左右,请问是正常的吗
Checklist
- [X] I have provided all relevant and necessary information above.
- [X] I have chosen a suitable title for this issue.