distributed-llm topic

List distributed-llm repositories

distributed-llama

2.7k
Stars
194
Forks
2.7k
Watchers

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.