Can we customize base_url for openai compatible LLM models instead of using openai models?

[ahalamora1981]

❓ Questions and Help

Can we customize base_url for openai compatible LLM models instead of using openai models?

I didn't find this setting in .env example file. Appreciate if this can be supported.

Thanks! TJ

[minne100]

I have the same question, can I use the local LLM like ollama?

[XianBW]

similar problem: issue#433

[JakobWong]

I had the same issue. Was able to create a workaround by implementing my own APIBackend class