[Feature request] Support OpenAI-compatible (OpenRouter, Ollama, etc.)

[matbgn]

To fix #18 properly, is it possible to implement the OpenAI generic approach?

Like done here: https://docs.magnitude.run/reference/llm-configuration#openai-compatible-openrouter%2C-ollama%2C-etc

[PairZhu]

I didn't fully understand your intentions. Isn't it compatible with openai interface at present? What is the problem you are experiencing?

[matbgn]

Maybe it's a lack of documentation, but as far I understand so far Krillin does not support Ollama configuration, or OpenRouter.

So if you could point out some basic information I can even imagine contributing to make a PR with proper docs ; but for now it's seems impossible.

[PairZhu]

Will there be any errors when using openrouter and ollama directly? Currently, as long as it is an OpenAI-compatible interface, it can be implemented by configuring baseUrl. If you encounter problems, please provide logs and error information, as well as the content of the configuration file after removing sensitive information