Amy Lu

icon indicating a website link amyxlu.github.io icon indicating an email [email protected]

icon location Berkeley icon location PhD student at UC Berkeley and BAIR

Results 1 issues of Amy Lu

`ScaledDotProduct` with attention mask returns different result as standard attention

3 comment

Great work on this project! I'm doing some benchmarking with key padding masking, but am getting a different answer for `xformers.components.attention.ScaledDotProduct` as compared to standard attention. Could you help clarify...