fastxtend icon indicating copy to clipboard operation
fastxtend copied to clipboard

Published 20 hours ago • verified publisher icon warner-benjamin

[WIP] Switch to optimi optimizers

Open warner-benjamin opened this issue 8 months ago • 0 comments

This PR replaces the fastxtend optimizers with optimi optimizers while retaining support for bitsandbytes eight-bit optimizers.

optimizer.utils adds a mixin class `` to assist in converting any PyTorch optimizer into a fastai-compatible optimizer. Look in optimizer.optimi for examples of how to use.

ToDo:

  • [ ] Finish documentation
  • [ ] Remove the fastxtend optimizers
  • [ ] Don't automatically import fastxtend optimizers?

warner-benjamin avatar Jun 09 '24 23:06 warner-benjamin