algorithmic-efficiency icon indicating copy to clipboard operation
algorithmic-efficiency copied to clipboard
verified publisher icon mlcommons

Add Lion baseline

Open tfaod opened this issue 6 months ago • 2 comments

  • Implementation: Google AutoML's Lion
  • Tunable hyperparameters: learning_rate, weight_decay, one_minus_beta1, beta2
  • Fixed hyperparameters: warmup_factor

tfaod avatar Aug 05 '25 19:08 tfaod

I'm unable to assign this to myself.

Image

cc: @priyakasimbeg

tfaod avatar Aug 05 '25 19:08 tfaod

EDIT - Able to able to myself. Thanks @priyakasimbeg

tfaod avatar Aug 07 '25 16:08 tfaod