fnet
fnet copied to clipboard
Masking/padding tokens in sequences of varied length ?
How can we mask/pad tokens for sequences of varied length ? When we use fft along dimension (-2) , sequences , if we just use zero padding the result will be skewed. torch.fft.fft2(x, dim=(-1, -2)).real