do-you-even-need-attention
do-you-even-need-attention copied to clipboard
Published
20 hours ago •
lukemelas
lukemelas
Positional Encoding Ablation
Hi Luke, thank you for sharing this amazing work.
In your arxiv document, I cannot find any mention of positional encoding, but I see that you use them in your code. Did you conduct any ablation study on the PE? i.e., how much does it affect the performance, with and without?
Thank you in advance.
