imagen-pytorch
imagen-pytorch copied to clipboard
reference of Learned Sinusoidal Position encoding
https://github.com/lucidrains/imagen-pytorch/blob/fa29d249a8bdd7b97ae0da8da02261fc69292b72/imagen_pytorch/imagen_pytorch.py#L610
Does anyone know the reference paper of this trick? Please let me know! Thanks~