distributed-training topic

HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.

DeNA

How to use Cross Replica / Synchronized Batchnorm in Pytorch

dougsouza

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Oneflow-Inc

[ICLR 2018] Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training

synxlin

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.

alibaba

OpenKS - 领域可泛化的知识学习与计算引擎

ZJU-OpenKS

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

skypilot-org

Dynamic training with Apache MXNet reduces cost and time for training deep neural networks by leveraging AWS cloud elasticity and scale. The system reduces training cost and time by dynamically updati...

awslabs

Distributed, mixed-precision training with PyTorch

richardkxu

A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch

bindog