mixture-of-experts topic

MoEL: Mixture of Empathetic Listeners

HLTCHKUST

Some recent state-of-the-art generative models in ONE notebook: (MIX-)?(GAN|WGAN|BigGAN|MHingeGAN|AMGAN|StyleGAN|StyleGAN2)(\+ADA|\+CR|\+EMA|\+GP|\+R1|\+SA|\+SN)*

tsc2017

PyTorch Implementation of the Multi-gate Mixture-of-Experts with Exclusivity (MMoEEx)

BorealisAI

Efficient global optimization toolbox in Rust: bayesian optimization, mixture of gaussian processes, sampling methods

relf

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

hiyouga

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

lucidrains

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

lucidrains

A toolbox for inference of mixture models

hanyas

Run Mixtral-8x7B models in Colab or consumer desktops

dvmazur

A curated reading list of research in Adaptive Computation, Dynamic Compute & Mixture of Experts (MoE).

koayon