helicone
helicone copied to clipboard
[Bug]: Unable to use Helicone with AzureOpenAI in local docker setup
What happened?
Hi,
I'm using below code:
HELICONE_BASE_URL="http://localhost:8585/v1"
default_headers = {
"Helicone-Auth": f"Bearer {HELICONE_API_KEY}",
"Helicone-OpenAI-API-Base": AZURE_OPENAI_ENDPOINT,
"api-key": AZURE_OPENAI_API_KEY,
}
default_query = {
"api-version": AZURE_OPENAI_API_VERSION
}
openai_client = AsyncAzureOpenAI(
api_version=AZURE_OPENAI_API_VERSION,
base_url=HELICONE_BASE_URL,
default_headers=default_headers,
api_key=HELICONE_API_KEY,
)
It returns below error:
openai.NotFoundError: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Cannot POST /v1/GPT-4o/deployments/GPT-4o/chat/completions</pre>
</body>
</html>
There is no option to add Azure integration in the UI. So I'm not sure if it is expecting to have a model added before making the request.
Relevant log output
Twitter / LinkedIn details
No response
thanks for your requests, the team is looking into this
Any updates? @devinat1
@devinat1 was this resolved?