Phil Wang
agent-attention-pytorch
Implementation of Agent Attention in Pytorch
equiformer-diffusion
Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some additional improvements
kalman-filtering-attention
Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
coordinate-descent-attention
Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
holodeck-pytorch
Implementation of a holodeck, written in Pytorch
TPDNE
Thispersondoesnotexist went down, so this time, while building it back up, I am going to open source all of it.
all-normalization-transformer
A simple Transformer where the softmax has been replaced with normalization
AMIE-pytorch
Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
deep-linear-network
A simple implementation of a deep linear Pytorch module
dreamcraft3d-pytorch
Implementation of Dreamcraft3D, 3D content generation in Pytorch