attention
attention copied to clipboard
I have no idea what method "to_mask" helps.
Could you give me a brief expanantion, please? Anyway thanks a lot.
I am a newcomer to NLP. To my knowledge about computer vision, I guess it is a kind of regularization like label smoothing stuff.....Also, I find that this method has appeared in your repositories many times.