text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Moondream2 | TGI Model support | Intel GPU

Open rskasturi opened this issue 7 months ago • 1 comments

Feature request

Hi, It seems like the list of models currently doesn't support Moondream2, do we have it in the pipeline to support it? meanwhile can you also point me to relevant documentation to add support for this.

cc: @sywangyi

Motivation

Moondream is an Open Source VLM Model card: vikhyatk/moondream2 More info here: https://moondream.ai/

Your contribution

I'm interested to learn and understand the pipeline to add model support on TGI, can you also point me to relevant documentation to add support for this.

Thank you!

rskasturi avatar Mar 12 '25 10:03 rskasturi