tensor-parallelism topic
List
tensor-parallelism repositories
torchshard
293
Stars
15
Forks
Watchers
Slicing a PyTorch Tensor Into Parallel Shards
petals
8.8k
Stars
474
Forks
18
Watchers
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
pipegoose
74
Stars
17
Forks
Watchers
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
JORA
20
Stars
0
Forks
Watchers
JORA: JAX Tensor-Parallel LoRA Library