krzysiekpodk

Hey @turboderp would be so kind and give some example how to run model with a LorA? It would mean a world to me as I wasted 3 days and...

Big fan of CT2 here as well, changing LorA would allow for the following use case: Coding model loaded (i.e. top Wizard Coder) In the chat interface we check the...

I can confirm various issues with GPTQ and Lora - I have tested all available drivers and cuda combinations I have also used Exllama docker. I either have the issue...

I an confirm this issue doesn't replicate in EXL2 LorA implementation, so I don't think its worth to troubleshoot.