Swin-Transformer icon indicating copy to clipboard operation
Swin-Transformer copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Codes about using performer as the attetion module.

Open luogen1996 opened this issue 3 years ago • 1 comments

Thanks for the solid and great work. Could you release the codes of swin transformer with performer attention. I have tried to reproduce the results of Tab. 6, but the usage of attention mask for performer attention still confused me. So i will appreciate if any codes or advice can be provided.

luogen1996 avatar Jun 21 '21 08:06 luogen1996

Any updates on this issue? I'd also like to know how you apply Performer into your architecture, as shown in Table 5&6.

HubHop avatar Mar 15 '22 00:03 HubHop