alignment-handbook icon indicating copy to clipboard operation
alignment-handbook copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Early Stopping Issue when used with ConstantLengthDataset

Open sankydesai opened this issue 11 months ago • 0 comments

Hello I modified the code to include the Constant Length Dataset and it's early stopping at around 15% of the training. This issue doesn't occur when not used with the normal code given. Is there an issue with constant length dataset? I used it with SFTTrainer.

sankydesai avatar Mar 08 '24 23:03 sankydesai