outlines icon indicating copy to clipboard operation
outlines copied to clipboard

Add support for the Chat input for the TGI model

Open RobinPicard opened this issue 3 months ago • 0 comments

This does not seem possible for the moment as the InferenceClient class of huggingface_hub has 2 different methods: generate_text and chat_completion. Only the 1st one supports structured output while only the 2nd one supports the chat input.

RobinPicard avatar Aug 29 '25 12:08 RobinPicard