Code Completion for Azure

[QuadStingray]

Describe the need of your request

Code Completion sounds fantastic, and I would love to test it. When do you plan to activate this awesome feature for Azure OpenAI or Custom OpenAI Providers?

Proposed solution

No response

Additional context

I like your Plugin and use it nearly every day

[PhilKes]

You should be able to use Azure for code-completions now (https://github.com/carlrobertoh/CodeGPT/pull/476) In the Custom OpenAI Providers settings:

[FabGoe]

Thanks for the implemention. I tried the recent Azure GPT3 and GPT4 models, which only support the "chat/completations" API (not the normal "/completations" API). I cannot get it to run. The connection test fails (see screenshot).

[sisve]

That is correct, you would need to create a separate deployment using the gpt-3.5-turbo-instruct model to use the /completions api. Azure seems to ignore the model provided in the request body, and instead use the one associated with your deployment.

[FabGoe]

@sisve Thanks for your help and fast response! I got it working now with gpt-3.5-turbo-instruct. This wasn't documented well in the Azure OpenAI manuals.