Phil Wang
DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
mixture-of-experts
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
byol-pytorch
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
imagen-pytorch
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
triton-transformer
Implementation of a Transformer, but completely in Triton
stylegan2-pytorch
Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement