attention-is-all-you-need-pytorch icon indicating copy to clipboard operation
attention-is-all-you-need-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon jadore801120

why PEpos+k can be represented as a linear function of PEpos?

Open myrainbowandsky opened this issue 2 years ago • 0 comments

In the original paper: section 3.5

PEpos+k can be represented as a linear function of PEpos.

How to prove that?

myrainbowandsky avatar Sep 16 '21 13:09 myrainbowandsky