MedicalGPT icon indicating copy to clipboard operation
MedicalGPT copied to clipboard

使用run_pt.sh对llama-13B在医疗数据上增量训练,跑了5个epoch,可是loss不下降是怎么回事?一直是10.25附近波动

Open nlper-hou opened this issue 1 year ago • 2 comments

Describe the Question

Please provide a clear and concise description of what the question is.

Describe your attempts

  • [ ] I walked through the tutorials
  • [ ] I checked the documentation
  • [ ] I checked to make sure that this is not a duplicate question

nlper-hou avatar Jun 15 '23 12:06 nlper-hou