AQLM icon indicating copy to clipboard operation
AQLM copied to clipboard

Added global funetuning & validation loss early stopping & gemma support

Open Godofnothing opened this issue 1 year ago • 0 comments

In this pull request following features are added:

  • full finetuning with teacher logits
  • validation loss is tracked instead of the rate of loss change on validation
  • gemma models support

Godofnothing avatar Mar 11 '24 17:03 Godofnothing