AoANet icon indicating copy to clipboard operation
AoANet copied to clipboard

feature mask problem

Open upccpu opened this issue 4 years ago • 1 comments

Hi, @husthuaan. I have a question about the Layer Norm. Why don't you apply mask in Layer Norm if you using adpative feature.

upccpu avatar Jul 29 '20 06:07 upccpu

In LayerNorm, features won't affect others.

husthuaan avatar Nov 10 '20 02:11 husthuaan