mixture-of-models topic

List mixture-of-models repositories

SwitchTransformers

44
Stars
8
Forks
Watchers

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"