Ben Murrell

I'm wondering the same.

This should be easy, convenient, and visible (so that the user is aware of the possible footgun). That rules out 5. > `Optimisers.adjust!(os, SignDecay(0.3))`, passing a whole new rule. Will...

> Obviously just the rule, surely? If you have setup Momentum, and do adjust!(... AdamW...) in any form, it can't replace the whole rule because it can't change the saved...

This was my fix: https://github.com/MurrellGroup/Jjama3.jl/blob/main/ext/MetalExt.jl