transformer
transformer copied to clipboard
The reason why removed keys masking and query masking?
Is there a no influence before do this?
the author did not remove the key masking but the query masking, no influence to the result since it will mask in the final output in the loss calculation