Squeezeformer icon indicating copy to clipboard operation
Squeezeformer copied to clipboard

Published 20 hours ago • verified publisher icon kssteven418

Masking Attention

Open longlnOff opened this issue 1 year ago • 0 comments

How can I pass mask argument to use local attention instead of global attention in MHA module? Thank Sir!

longlnOff avatar Jul 07 '23 08:07 longlnOff