MedicalGPT
MedicalGPT copied to clipboard
使用run_pt.sh对llama-13B在医疗数据上增量训练,跑了5个epoch,可是loss不下降是怎么回事?一直是10.25附近波动
Describe the Question
Please provide a clear and concise description of what the question is.
Describe your attempts
- [ ] I walked through the tutorials
- [ ] I checked the documentation
- [ ] I checked to make sure that this is not a duplicate question