text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Allow multi-lora in Messages API

Open nbroad1881 opened this issue 6 months ago • 5 comments

Feature request

Multi lora support in TGI has been around since 2.0.6, but it is not compatible with the Messages API using the openai package.

Motivation

The openai chat completion approach is an industry standard at this point, so having it be compatible with multi lora would be great.

Your contribution

.

nbroad1881 avatar Aug 20 '24 15:08 nbroad1881