generative-inference topic

List generative-inference repositories

HexGen

30
Stars
8
Forks
Watchers

Serving LLMs on heterogeneous decentralized clusters.

verified publisher icon Relaxed-System-Lab