natural-gradients
natural-gradients copied to clipboard
full fisher script stability
I looked at the full_fisher numpy file and tried to change some parameters but it doesn't work. For example, when the X0
and X1
are changed as follows, the loss becomes nan
after two steps:
X0 = np.random.randn(100, 2) - 2
X1 = np.random.randn(100, 2) + 2
What is the problem here? Thanks for your time.