Phil Wang
einops-exts
Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
equiformer-pytorch
Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and adopted for use by EquiFold for protein folding
ESBN-pytorch
Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch
flash-attention-jax
Implementation of Flash Attention in Jax
insertion-deletion-ddpm
Implementation of Insertion-deletion Denoising Diffusion Probabilistic Models
isab-pytorch
An implementation of (Induced) Set Attention Block, from the Set Transformers paper
ITTR-pytorch
Implementation of the Hybrid Perception Block and Dual-Pruned Self-Attention block from the ITTR paper for Image to Image Translation using Transformers
kronecker-attention-pytorch
Implementation of Kronecker Attention in Pytorch
learning-to-expire-pytorch
An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
phenaki-pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch