How to set a custom OpenAI endpoint `OPENAI_API_BASE`

[QIanGua]

I have an OpenAI Key associated with a specific OpenAI API Base, such as https://openaiXXX.cloud/v1, instead of the default base https://api.openai.com/v1. This key enables me to run it successfully.

curl $OPENAI_API_BASE/models \
      -H "Authorization: Bearer $OPENAI_API_KEY" \
      -H "OpenAI-Organization: org-mvUSw9fFhNVVqQUesafVo0F6"

I only find how to set OpenAI Key SystemCredential["OPENAI_API_KEY"] = xxx.

[raverydavis]

Hi, this is a feature we're currently working on supporting (allowing users to register their own defined service connections instead of the built-in ones we have for LLMs) https://github.com/WolframResearch/Chatbook/tree/feature/LLMServices is laying the groundwork for this change and we'll have supporting functions to register and de-register an "LLM Service" (this just means a service connection that is an LLM)

Stay tuned!

[ayaka209]

We are now able to manage LLM services, but unfortunately, we still lack the ability to add or modify services.