phospho
Results
2
repositories owned by
phospho
fastassert
28
Stars
0
Forks
Watchers
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API...
phospho
357
Stars
27
Forks
Watchers
Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, MistralAI, Ollama, etc.)