Optimisers.jl icon indicating copy to clipboard operation
Optimisers.jl copied to clipboard

Add `Lookahead` optimiser

Open mcabbott opened this issue 3 years ago • 0 comments

This is simpler than the version in https://github.com/FluxML/Flux.jl/pull/969, as it has no special handling for momentum, or not yet.

It's unusual in that I think it needs to be written as an update! rule, not an apply! rule.

Cc @chengchingwen who wrote the Flux PR.

mcabbott avatar Mar 07 '22 05:03 mcabbott