FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

overfit and why?

Open paulcx opened this issue 2 years ago • 3 comments

So far all my attempts, with different models, sizes, and datasets have led to one issue: the evaluation loss keeps increasing. see my log image

paulcx avatar Apr 11 '23 22:04 paulcx

What data set do you use? How did you split the train and eval?

merrymercy avatar Apr 12 '23 20:04 merrymercy

is this issue resolved? @paulcx

zhisbug avatar Apr 22 '23 00:04 zhisbug

not yet

paulcx avatar Apr 22 '23 00:04 paulcx

There are two few pieces of information about your data and your detailed setup. We're unable to offer any help give these information. Closing. If you still face the problem, feel free to open up an new issue and include all information about your setup.

zhisbug avatar May 08 '23 07:05 zhisbug