SASRec.pytorch icon indicating copy to clipboard operation
SASRec.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon pmixer

Adding attention output to query vector?

Open jeffreymei opened this issue 4 years ago • 1 comments

https://github.com/pmixer/SASRec.pytorch/blob/72ba89d4a1d0319389ef67ee416e33b7431c8b9b/model.py#L85

Can you explain what this line does? Why is the attention output being added to Q?

jeffreymei avatar Sep 16 '21 16:09 jeffreymei

https://github.com/pmixer/SASRec.pytorch/blob/72ba89d4a1d0319389ef67ee416e33b7431c8b9b/model.py#L85

Can you explain what this line does? Why is the attention output being added to Q?

skip connection like the one used in ResNet, here's how they implemented in tf by the paper author:

https://github.com/kang205/SASRec/blob/e3738967fddab206d6eeb4fda433e7a7034dd8b1/modules.py#L219

pmixer avatar Sep 17 '21 02:09 pmixer