killandy

Orthonorm layer weights

4

Hi, I have some trouble about the orthogonality training steps. I noticed that the orthogonality layer is actually a Keras Lambda layer which only do the simple operation of inputs....

It seems that muFunds do not support China funds (morningstar.cn). Is there any plan for supporting it?

neumann_hyperstep_preconditioner

2

Hi, I'm confused by the function neumann_hyperstep_preconditioner since I found two versions of it. One in the rnn/train.py computes the hessian_term as : `hessian_term = (counter.view(1, -1) @ d_train_loss_d_w.view(-1, 1)...