GraphWriter icon indicating copy to clipboard operation
GraphWriter copied to clipboard

About Position Encoding

Open wutaiqiang opened this issue 4 years ago • 1 comments

Hey,i noticed that you did not use the positional encoding in the model but the orginal Transformer Model used the triangle positional encoding, why did not you use that ? was the PE useless?

wutaiqiang avatar Apr 04 '20 13:04 wutaiqiang

I don't know how to include position encoding in a graph because there is no ordering to the nodes.

rikdz avatar Apr 04 '20 14:04 rikdz