Jan Strich

icon company University of Hamburg icon location Hamburg icon location Research Scientist at the University of Hamburg

Results 2 comments of Jan Strich

[Feature]: Online Inference on local model with OpenAI Python SDK

Seems to me here are some bots with suspect links 👀

[Feature]: Online Inference on local model with OpenAI Python SDK

Hey, you can find my docker setup here: https://github.com/vllm-project/vllm/issues/8567. I have mounted the directory into the docker. Okay, I see I don't know exactly how to implement it, but I...