Please include the option to insert a custom model

Open yf007 opened this issue 1 year ago • 2 comments

Like this

OPENAI_ENDPOINT=https://some-private.com/v1 OPENAI_API_KEY=****

Thanks

Mar 23 '24 19:03 yf007

This PR moves to LiteLLM, which I think should support this.

Mar 23 '24 20:03 rbren

Confirmed: https://github.com/BerriAI/litellm/blob/05dfc9e6acee94af7216288cd3af25a446a39c14/docs/my-website/docs/providers/openai.md?plain=1#L53

Mar 23 '24 20:03 rbren

See here for how to select a custom model: https://github.com/OpenDevin/OpenDevin?tab=readme-ov-file#picking-a-model

You can use the OPENAI_API_BASE env var to select a different OpenAI endpoint

Mar 26 '24 12:03 rbren