fsdp topic

🦾💻🌐 distributed training & serverless inference at scale on RunPod

SohamGovande

Best practices & guides on how to write distributed pytorch training code

LambdaLabsML

META LLAMA3 GENAI Real World UseCases End To End Implementation Guide

GURPREETKAURJETHRA

Repo for Qwen Image Finetune

tsiendragon

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

meta-pytorch

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

sgl-project