Phil Wang

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

lucidrains

Implementation of MetNet-3, SOTA neural weather model out of Google Deepmind, in Pytorch

lucidrains

Implementation of the Llama architecture with RLHF + Q-learning

lucidrains

Implementation of a simple BPE tokenizer, but in Nim

lucidrains

Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new AI research

lucidrains

Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch

lucidrains

A repository to house some personal attempts to beat some state-of-the-art for medical datasets

lucidrains

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch

lucidrains

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

lucidrains

A Transformer made of Rotation-equivariant Attention using Vector Neurons

lucidrains