data-parallelism topic

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

microsoft

A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead

mratsim

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

cerndb

Making large AI models cheaper, faster and more accessible

hpcaitech

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

wenwei202

Distributed Keras Engine, Make Keras faster with only one line of code.

dkeras-project

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

PaddlePaddle

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Oneflow-Inc

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.

alibaba

Orkhon: ML Inference Framework and Server Runtime

vertexclique