Optimisers.jl
Optimisers.jl copied to clipboard
Add `Lookahead` optimiser
This is simpler than the version in https://github.com/FluxML/Flux.jl/pull/969, as it has no special handling for momentum, or not yet.
It's unusual in that I think it needs to be written as an update! rule, not an apply! rule.
Cc @chengchingwen who wrote the Flux PR.