Sean Peldom Zhang

icon company Westlake University icon location Hangzhou, Zhejiang, China icon location Official name: Yanzhe Zhang

Results 2 issues of Sean Peldom Zhang

losses went into inf/nan if optimizer is not SGD

5 comment

I tested other optimizers like adam/rmsprop/momentum from '[jax.example_libraries.optimizers'](https://github.com/google/jax/blob/36cd56824def5a6caac2cf1b837f676cfbc8dfb7/jax/example_libraries/optimizers.py). As design initiated, the whole structure predicted by AlphaFold2 became a “black hole” after 10-20 steps, then loss value changed into inf/nan...

Work of Genius!

Excellent and Vicious ideas!