sparsely-gated-mixture-of-experts topic

List sparsely-gated-mixture-of-experts repositories

mixture-of-experts

865
Stars
92
Forks
Watchers

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538