distributed-optimizers topic

List distributed-optimizers repositories

dist-keras

623
Stars
170
Forks
Watchers

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

pipegoose

77
Stars
17
Forks
Watchers

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*