LLM-Finetuning-Toolkit icon indicating copy to clipboard operation
LLM-Finetuning-Toolkit copied to clipboard

[LoRA] Use Validation Set

Open benjaminye opened this issue 1 year ago • 0 comments

If I have:

  • test_split: 0.1
  • train_split: 0.8

Maybe we can get calc_val_split=1-0.1-0.8=0.1 split as validation. Maybe also apply something like max(calc_val_split, 0.05) to prevent val split to be too big

benjaminye avatar Apr 03 '24 15:04 benjaminye