3d-parallelism topic

List 3d-parallelism repositories

Stars

Forks

Watchers

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*