Universal-Transformer-Pytorch icon indicating copy to clipboard operation
Universal-Transformer-Pytorch copied to clipboard

Published 20 hours ago • verified publisher icon andreamad8

Question about PE

Open smiles724 opened this issue 4 years ago • 0 comments

Hi, I did notice you implement the function to calculate the position embedding. However, I found nowhere it was used. Can you please help me understand how you incorporate the position information into the model?

smiles724 avatar Jun 14 '21 10:06 smiles724