ARIS icon indicating copy to clipboard operation
ARIS copied to clipboard

Published 20 hours ago • verified publisher icon Lipurple

Some question about ARIS

Open shydyl opened this issue 2 years ago • 0 comments

Thank you for the wonderful research! There is some trouble when I try to reproduce the ARIS Residual is used wildly in Transformer. When I change the shape of Q(Q_SR), the output shape of ARIS is different to K and V, so I cannot add them together. How do you deal with it ?

shydyl avatar Oct 11 '22 15:10 shydyl