Detection and problem solving for datasette llm

[Lewiscowles1986]

Hello 👋

Thanks for authoring this.

Is there a way to know if a mlx model is vision supporting? In order to try your code, I modified the llm project by Simon Willison's llm-mlx plugin to call your code. fork

The thing is I neither have the time to do this right, nor will my employer be interested. I raised an issue against ml-explore/mlx-lm which feels really similar to this repo, and I wondered if you'd used their work of if you both used a common scaffold; and who of the two of you would prefer to own such an integration

They've declined the issue, which is fair enough. They dont seem to want to support vision models through Apple.

https://github.com/ml-explore/mlx-lm/issues/488

I'm wondering if you may feel differently?

[Blaizzy]

Hi @Lewiscowles1986

You came to the right place!

How can I help?

[Lewiscowles1986]

Hi @Blaizzy,

Probably the most value to me is

Is there a way to know if a mlx model is vision supporting?

Everything else feels separate.