Custom OpenAI Update

[marcoscale98]

Describe the need of your request

The "v1/completion" API is old and in deprecation.

Proposed solution

Update the settings of "Code completion" in the ProxyAI Settings with: Chat Completion API (in code completion), and especially Responses API

Additional context

No response

[gmontamat]

This is related to https://github.com/carlrobertoh/ProxyAI/issues/369

So the question is: how do we do code completion with the new /v1/chat/completions API and which shall we use?

edit: did some research and up until July 2024, /v1/completions with gpt-3.5-turbo-instruct was the recommended endpoint for code completion https://community.openai.com/t/using-chat-models-as-completion-models/880393/5

edit 2: also looks like the openai API still supports the /v1/completions endpoint, so only those with a custom openai API endpoint without completions support can't use it

[gmontamat]

See https://github.com/carlrobertoh/ProxyAI/pull/1103