transformer icon indicating copy to clipboard operation
transformer copied to clipboard

The reason why removed keys masking and query masking?

Open user683 opened this issue 4 years ago • 1 comments

Is there a no influence before do this?

user683 avatar May 25 '20 09:05 user683

the author did not remove the key masking but the query masking, no influence to the result since it will mask in the final output in the loss calculation

GuoshenLi avatar Jul 14 '21 13:07 GuoshenLi