flair icon indicating copy to clipboard operation
flair copied to clipboard

[Question]: Serve flair model using vllm or huggingface TGI

Open JINO-ROHIT opened this issue 5 months ago • 2 comments

Question

Hi, Is there a way to serve the flair models using huggingface TGI or vllm or any other inference engine?

JINO-ROHIT avatar Jul 23 '25 16:07 JINO-ROHIT

@helpmefindaname gentle ping

JINO-ROHIT avatar Jul 24 '25 06:07 JINO-ROHIT

i want to serve flair models faster but rn its currenyl slow

JINO-ROHIT avatar Jul 24 '25 06:07 JINO-ROHIT