tuning_playbook
tuning_playbook copied to clipboard
Typo: Missing parenthesis in nesterov momentum
FAQs -> What are the update rules for all the popular optimization algorithms? -> Nesterov
A closing parenthesis is missing in the third equation. It's currently
$$\theta_{t+1} = \theta_{t} - \eta_t( \gamma v_{t+1} + \nabla \mathcal{l}(\theta_{t})$$
and should be
$$\theta_{t+1} = \theta_{t} - \eta_t( \gamma v_{t+1} + \nabla \mathcal{l}(\theta_{t}))$$
Hey, can I work on this typo?
Thanks for pointing this out! Please feel free to send me a pull request.
I think @znado just merged the PR to fix this. Closing this issue for now.