Optimization.jl icon indicating copy to clipboard operation
Optimization.jl copied to clipboard

Optimizer documentation style

Open ChrisRackauckas opened this issue 3 years ago • 1 comments

I'm not sure we have the optimizer documentation style down quite yet. It has all of the right elements, but I think it's quite busy. So let's discuss this a bit. Currently we have:

  • Flux.Optimise.ADAM: ADAM optimizer

    • solve(problem, ADAM(η, β::Tuple))
    • η is the learning rate
    • β::Tuple is the decay of momentums
    • defaults to: η = 0.001, β::Tuple = (0.9, 0.999)

My suggestion is to cut this down a bit, i.e.

thoughts?

ChrisRackauckas avatar Dec 23 '20 14:12 ChrisRackauckas

Good idea, I'm now changing those parts.

mkg33 avatar Jan 29 '21 06:01 mkg33