ResidualAttentionNetwork-pytorch icon indicating copy to clipboard operation
ResidualAttentionNetwork-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon tengshaofeng

What is the meaning of `softmax` in attention_module.py?

Open theodoruszq opened this issue 5 years ago • 0 comments

Hi, I am confused about the term softmax_blocks. The term in the paper should be soft mask blocks? I check the ResidualBlock class which does not exist normalization layers.

theodoruszq avatar Feb 20 '20 14:02 theodoruszq