mixture-of-models topic
List
mixture-of-models repositories
SwitchTransformers
44
Stars
8
Forks
Watchers
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"