fastassert
fastassert copied to clipboard
Published
20 hours ago •
phospho-app
phospho-app
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API...
Results
0
fastassert issues
Sort by
recently updated
recently updated
newest added
Metadata
26
Stars
0
Forks
Watchers
Owner
Metadata
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API...