Vincent Roulet issues

Results 5 issues of


                                            Vincent Roulet

Reducing compilation times

The plan of this PR is to reduce the number of times the objective function is compiled. I started by adding a test in common_tests to see how many times...

Add a mathematical description of the algorithms

Like adam or nadam, it would be nice to have mathematical descriptions of as many algorithms as possible. To start with, having a clear description of what sgd with momentum...

documentation

good first issue

Remove multi_normal from docs (in utilities.rst) or add dosctring to multi_normal (in utils.py).

documentation

good first issue

Rationale to dimiss strong wolfe linesearch

Hello, Thank you for all your work! I was wondering why in the docstring of the strong wolfe linesearch the authors say the following. ``` This algorithm is mostly of...

Updates dtype do not need to match params dtype but only grads dtype a priori

Revise #1060 in light of the discussion of #1039. Namely, make tests ensure that dtype of grads is preserved (not necessarily the same as the dtype of params for e.g....