fnet-pytorch
fnet-pytorch copied to clipboard
erksch
Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
Hey, Wonderful translation! I just implemented it myself, but this FourierMatmul is giving error of dimension mismatch. Can you please let me know what are the dimensions it expects? Please...
How can we mask/pad tokens for sequences of varied length ? When we use fft along dimension (-2) , sequences , if we just use zero padding the result will...
Hi, I am currently working on reproducing the results from the paper on the GLUE benchmark. However, my current results are very far from those in the paper. Have you...
Great job, mate! I will have a look at your implementation thoroughly a bit later, for now it seems outstanding for me 🤙🏻
