ISTR icon indicating copy to clipboard operation
ISTR copied to clipboard

Published 20 hours ago • verified publisher icon hujiecpp

About position embeddings

Open ding-Chen opened this issue 3 years ago • 1 comments

I didn't understand how to position embedding got in this paper. I read this article in detail, but I didn't find the answer. Could you please introduce it? Thank you.

ding-Chen avatar Jun 16 '21 03:06 ding-Chen

I didn't understand how to position embedding got in this paper. I read this article in detail, but I didn't find the answer. Could you please introduce it? Thank you.

Hi @ding-Chen , You can treat the position embeddings as the randomly initialized learnable vectors.

hujiecpp avatar Jun 21 '21 05:06 hujiecpp