llmapi topic

List llmapi repositories

optillm

3.3k
Stars
261
Forks
3.3k
Watchers

Optimizing inference proxy for LLMs

eko

4.8k
Stars
434
Forks
4.8k
Watchers

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

llmproxy

17
Stars
0
Forks
17
Watchers

🧭🧭 An intelligent load balancer with smart scheduling that unifies diverse LLMs.