attention-is-all-you-need-pytorch
attention-is-all-you-need-pytorch copied to clipboard
why PEpos+k can be represented as a linear function of PEpos?
In the original paper: section 3.5
PEpos+k can be represented as a linear function of PEpos.
How to prove that?