CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

Dynamic LoRA switching

Open MrigankRaman opened this issue 10 months ago • 2 comments

Hi! This has been an awesome project and helped me a lot. I was wondering can we get dynamic lora switching in ctranslate2? Afaik TensorRTLLM has it

MrigankRaman avatar Apr 27 '24 05:04 MrigankRaman

I would also like to have this feature as well 🙂

anterart avatar May 06 '24 15:05 anterart

I would also like to have this feature as well, this would be great feature to have

Jeevi10 avatar Aug 19 '24 19:08 Jeevi10