flair
flair copied to clipboard
[Question]: Serve flair model using vllm or huggingface TGI
Question
Hi, Is there a way to serve the flair models using huggingface TGI or vllm or any other inference engine?
@helpmefindaname gentle ping
i want to serve flair models faster but rn its currenyl slow