LMFlow icon indicating copy to clipboard operation
LMFlow copied to clipboard

How can I use other optimizers in LISA?

Open greatzane opened this issue 1 year ago • 1 comments

I tried to pass --optim , nothing happens. How can I use optimizers such as adamw_8bit or adafactor in LISA? They are not in the custom_optimizers either.

greatzane avatar Aug 22 '24 02:08 greatzane

Thanks for your interest in LMFlow! Normally LISA should effect all optimizers. We are wondering if you could provide the screenshot of the problem so we could check that for you? Thanks very much for providing the suggestion 😄

research4pan avatar Sep 03 '24 03:09 research4pan