Synthesizer icon indicating copy to clipboard operation
Synthesizer copied to clipboard

Published 20 hours ago • verified publisher icon 10-zin

Why does encoder still use vanilla dot-product self-attention?

Open TianmingQiu opened this issue 4 years ago • 0 comments

Here the synthesizer decoder uses dot-product self-attention for encoder-decoder attention. Is that correct?

TianmingQiu avatar Jan 26 '21 09:01 TianmingQiu