dynamical-isometry topic
List
dynamical-isometry repositories
mean-field-theory-deep-learning
75
Stars
7
Forks
Watchers
paper lists and information on mean-field theory of deep learning
Dynamical-Isometry-from-Orthogonality-Neural-Nets
17
Stars
2
Forks
Watchers
Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.