transformer icon indicating copy to clipboard operation
transformer copied to clipboard

Correct key_masks shape

Open gowtham1997 opened this issue 5 years ago • 0 comments

The mask function defined in the modules.py expects key_masks to be a 2d-tensor of shape (N, T_k), but the comments describe it as a 3d tensor. (N, 1, T_k).

gowtham1997 avatar Oct 16 '19 12:10 gowtham1997