Let the model capabilities be reported by the model provider
Is your feature request related to a problem? Please describe.
when a new model is supported by ollama, or a niche model is supported by ollama but not in alpaca's hard-coded database, its tools capabilities are reported incorrectly (maybe also its vision capabilities, i have not checked)
Describe the solution you'd like
i know a rewrite is happening, so maybe it would be good to keep in mind that most model providers can report the capabilities of their model for tools and vision. Maybe let each instance report on that instead of hard-coding it
Describe alternatives you've considered
not much of an alternative, but some instance might also not be reporting the capabilities correctly, in which case, adding a little toggle for the users who know what they are doing to switch on or off tools or vision might be nice
Additional context
see #744 for more information