DennisHaijma

icon company 127.0.0.1 icon location Amsterdam, The Netherlands icon location Hello World

Results 1 comments of DennisHaijma

Self-attention weights don't always sum to 1

Thanks for your reply. I witness artefacts when calculating approximated weighted attention distances for each instance using its row-vector of attention weights. Whether my computation is right or wrong and...