[Feature Request] Add support for OpenAI compatible API server

[Extremys]

Hello @Blaizzy, it would be so great to have a similar OpenAI Compatible server like in https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/SERVER.md but supporting also image modality, what do you think?

[Blaizzy]

Hey @Extremys

Thanks, that's a really good idea.

I'm already working on it and should be available soon, but it's still a private repo.

Let me know if you want to help and I will add you there.

It will support multimodal inputs and much more.

[Blaizzy]

@Extremys I built it :)

It's called FastMLX:

https://github.com/Blaizzy/fastmlx