ChatGLM2-6B icon indicating copy to clipboard operation
ChatGLM2-6B copied to clipboard

eval_loss不降反增

Open xxm1668 opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe.

ChatGLM2-6b lora微调,train_loss一致下降,但eval_loss不降反增;

同样的数据,同样的配置参数,ChatGLM-6b,这两个loss都是下降的,咋回事呢?

Solutions

eval_loss不降反增

Additional context

eval_loss不降反增

xxm1668 avatar Jun 30 '23 10:06 xxm1668