Alpaca icon indicating copy to clipboard operation
Alpaca copied to clipboard

Let the model capabilities be reported by the model provider

Open heredos opened this issue 10 months ago • 0 comments

Is your feature request related to a problem? Please describe.

when a new model is supported by ollama, or a niche model is supported by ollama but not in alpaca's hard-coded database, its tools capabilities are reported incorrectly (maybe also its vision capabilities, i have not checked)

Describe the solution you'd like

i know a rewrite is happening, so maybe it would be good to keep in mind that most model providers can report the capabilities of their model for tools and vision. Maybe let each instance report on that instead of hard-coding it

Describe alternatives you've considered

not much of an alternative, but some instance might also not be reporting the capabilities correctly, in which case, adding a little toggle for the users who know what they are doing to switch on or off tools or vision might be nice

Additional context

see #744 for more information

heredos avatar May 01 '25 15:05 heredos