Kye Gomez

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

kyegomez

Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"

kyegomez

Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"

kyegomez

Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊

kyegomez

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

kyegomez

Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"

kyegomez

Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT and saves 86.8% GPU memory when...

kyegomez

Implementation of a modular, high-performance, and simplistic mamba for high-speed applications

kyegomez

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

kyegomez

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

kyegomez