Jinseok Son

Any plan for Lion optimizer support?

1

Do you have any plans to support Lion, an optimizer that is claimed to be more memory-efficient and perform better than Adam? https://arxiv.org/abs/2302.06675