Phil Wang
global-self-attention-network
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
bit-diffusion
Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch
g-mlp-gpt
GPT, but made only out of MLPs
jax2torch
Use Jax functions in Pytorch
mlp-gpt-jax
A GPT, made only of MLPs, in Jax
feedback-transformer-pytorch
Implementation of Feedback Transformer in Pytorch
lie-transformer-pytorch
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
uniformer-pytorch
Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022
HTM-pytorch
Implementation of Hierarchical Transformer Memory (HTM) for Pytorch
RQ-Transformer
Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"