multi-gpu-inference topic
List
multi-gpu-inference repositories
inferflow
235
Stars
24
Forks
Watchers
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
PyTorch-Multi-GPU-Multi-Process-Testing
19
Stars
6
Forks
Watchers
A script for PyTorch multi-GPU multi-process testing
DistRL-LLM
21
Stars
1
Forks
21
Watchers
Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization