zilliztech
[Feature]: Support for Azure OpenAI
Is your feature request related to a problem? Please describe.
We are currently using Azure OpenAI to make API calls, seems that GPTCache only supports using the standard OpenAI API keys and it isn't possible to route the requests through Azure
Describe the solution you'd like.
OpenAI's library allows us to specify to route the requests through Azure with the following config:
openai.api_type = "azure"
openai.api_version = "2023-05-15"
openai.api_key = "<api key>"
openai.api_base = "https://<tenant>.openai.azure.com/"
model = "gpt-35-turbo"
Including support to do this through the GPTCache OpenAI adapter would be the way to replicate the same for GPTCache
Describe an alternate solution.
N/A
Anything else? (Additional Context)
No response
@amrit2cisco Do you mean to also introduce these constants in the openai file under gptcache?
@SimFG yes, and particularly the Azure OpenAI API key (which is fundamentally different from the vanilla OpenAI API Key) should be able to be used to route the requests to api_base in the absence of a standard OpenAI API key