cerebros-core-algorithm-alpha icon indicating copy to clipboard operation
cerebros-core-algorithm-alpha copied to clipboard

Add new SOTA optimizers to Cerebros

Open david-thrower opened this issue 2 years ago • 0 comments

Kind of issue: feature-request-or-enhancement

Add to the API:

In the stable API:

The tf.keras.optimizers.AdamW

To the experimental API add the Lion optimizer:

https://github.com/GLambard/Lion-tensorflow

Ultimately, make the selection of Adam, AdamW, Lion a tunable param (they both have learningrate as a param. Will need an integer selection as a key referencing which one, as Katib can't directly select a class.)

david-thrower avatar Mar 12 '23 04:03 david-thrower