George Shaikovski

icon company @Paige-AI icon location AI Research Engineer @Paige-AI | Work account: @gshaikov-paige

Results 1 issues of George Shaikovski

Weight sharing not consistent with paper

1 comment

Hi Phil, Want to confirm the reason behind this design choice: https://github.com/lucidrains/perceiver-pytorch/blob/c3d505a997a6e3521e83d7d2bf57cb8b62e3fbd6/perceiver_pytorch/perceiver_pytorch.py#L194-L210 In the paper, they say that they tie all the latent transformer weights. However in this implementation, TF...