alpaca-lora icon indicating copy to clipboard operation
alpaca-lora copied to clipboard

Published 20 hours ago • verified publisher icon tloen

--group_by_length flag train/loss anomoly

Open teknium1 opened this issue 1 year ago • 0 comments

What is the "odd train/loss" that is referenced to be caused by this flag? I have it on (and havent tested with it off) and my train/loss looks like this:

image

Is this consistent with the specific "oddness" the flag creates, or am I doing something else terribly wrong?

teknium1 avatar Apr 30 '23 14:04 teknium1