moondream icon indicating copy to clipboard operation
moondream copied to clipboard

How to use /detect /point with VLLM API

Open dhandhalyabhavik opened this issue 5 months ago • 1 comments

If I use VLLM based docker and expose moondream via OpenAI APIs, then how to use /detect or /point? OpenAI doesn't support those APIs right?

# Call the server using curl:
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vikhyatk/moondream2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

dhandhalyabhavik avatar Jul 10 '25 10:07 dhandhalyabhavik

Moondream does not work on vLLM.

AlexisMDP avatar Aug 18 '25 11:08 AlexisMDP