kervolution icon indicating copy to clipboard operation
kervolution copied to clipboard

Convergence

Open tolusophy opened this issue 2 years ago • 0 comments

This is an issue concerning the architectural arrangement.

In deeper layers, for example, in Resnet18, changing all convolutional layers to kervolutional layers (with degree 3), the network gives a NaN loss which suggests explosion. How do you arrange the architecture to give good results

tolusophy avatar May 02 '22 20:05 tolusophy