Haoran You

Results 5 comments of Haoran You

![image](https://user-images.githubusercontent.com/18202368/54808365-f7691d80-4cba-11e9-8597-39e6092b92c3.png) The model collapse very quickly with exploded loss. I want to figure out why.

It seems nothing to do with initialization methods.

I found it! the adam parameter beta_2 should never be 0.01 :)

> I found it! the adam parameter beta_2 should never be 0.01 :) Still collapse after few epochs :(

![image](https://user-images.githubusercontent.com/18202368/54830231-15527480-4cf3-11e9-8090-a16bb2d2aba9.png) Seems like collapse to one mode after 2/3,000 iterations, is here anybody can give a reason?