gpt-neox
gpt-neox copied to clipboard
Add MoE
Closes https://github.com/EleutherAI/gpt-neox/issues/479