Andre Sprenger

icon indicating a website link https://www.linkedin.com/in/asprenger

icon company Photonic Insights icon location Berlin / Hamburg icon location CTO @ Photonic Insights | ML Engineer | Working with LLMs | Embedded AI

Results 1 repositories owned by Andre Sprenger

ray_vllm_inference

49
Stars
4
Forks
Watchers

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.

verified publisher icon asprenger