mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard
verified publisher icon EricLBuehler

LoRA Support for Vision Models

Open anchpop opened this issue 2 months ago • 0 comments

Vision models do not currently support LoRA in mistralrs. This is problematic because the Gemma models are categorized as vision models, so they cannot be used with LoRAs.

To work around this for myself, I've added support for this in this commit on my fork. It seems to actually work, but I haven't made a PR because those changes are purely vibe-coded

anchpop avatar Oct 27 '25 16:10 anchpop