LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

feat(models): Hide mmproj for multimodal models

Open rampa3 opened this issue 3 months ago • 1 comments

Is your feature request related to a problem? Please describe.

While not explicitly problematic, in my opinion, it would be nice to hide mmprojs of multimodal models from the user, and only acknowledge them internally for loading into backends.

Describe the solution you'd like

Automatical (Maybe from filename?) or config file based way to hide mmprojs from the user of LocalAI, while still acknowledging them internally when a multimodal model gets requested.

Describe alternatives you've considered

Keeping current state, where mmprojs appear as non-configured models to the user.

Additional context

Image

rampa3 avatar Sep 17 '25 17:09 rampa3

that was indeed on top of my head, thanks for reminding me - One way to handle this is change the gallery layout and download mmproj files in a dedicated mmproj folder, while not being too much specific as identifying mmproj files might be too much expensive as well if having many models installed.

mudler avatar Sep 19 '25 16:09 mudler