Justin Bayer

Add Hessian free optimizer

5

There are several public releases already, - https://github.com/boulanni/theano-hf/ - http://www.cs.toronto.edu/~ilya/pubs/ - http://www.cs.toronto.edu/~gdahl/ which can serve as inspiration. I think that the first one is mainly interesting because it looks maximally...

Currently, some line searches do not cache the function values at the last step. The callers thus have to evaluate those again if necessary (or if the user wants to...

Convergence/Divergence

2

So we had that issue yesterday that climin should never stop iterating because it thinks it converged. However, it might happen that it diverges and that that needs to be...

@osdf has code, it only has to be adapted a little.

The construction of different arguments for each iteration of the optimizer is somehow tedious. However, in the case of some optimizers (HF, KSD) there are several arguments. E.g., KSD needs...

Make the wrt variable optionally be a pair containing a setter and a getter

1

Currently, the signature of optimizers only allows the following: ``` def __init__(self, wrt, f, ...): # ... ``` However, in some cases, this can lead to problems with the GPU:...

Hi, I find it irritating that the observations in the maze2d tasks only contain the 2d positions/velocities. If the agent is not informed about the goal location (which can be...