GAT icon indicating copy to clipboard operation
GAT copied to clipboard

A questions about attention

Open pangsg opened this issue 6 years ago • 1 comments

In the paper,we only concat the Whj and Whi,how does it reflect the imformation exchange between node i and node j?

pangsg avatar Jul 26 '19 07:07 pangsg

After the concatenation, GAT does a dot product of a tensor a and [Wh_i || Wh_j] to get a scalar

EtoDemerzel0427 avatar Aug 06 '19 21:08 EtoDemerzel0427