DennisHaijma

icon company 127.0.0.1 icon location Amsterdam, The Netherlands icon location Hello World

Results 1 issues of DennisHaijma

Self-attention weights don't always sum to 1

2 comment

Hi all, Nice work. I have a question however. I see with in my problem setting that the self-attention (SA) weights don't always sum to ~1 (row-wise). I assume this...