llm-proxy topic

List llm-proxy repositories

prompt_sail

46
Stars
0
Forks
Watchers

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

verified publisher icon PromptSail

olla

119
Stars
12
Forks
119
Watchers

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

verified publisher icon thushan