chat-with-your-data-solution-accelerator icon indicating copy to clipboard operation
chat-with-your-data-solution-accelerator copied to clipboard

Include BYOD environment variables in custom endpoint

Open cecheta opened this issue 1 year ago • 0 comments

Motivation

There are a number of env vars used when using Azure OpenAI On Your Data in the BYOD endpoint, which are not used when calling the custom endpoint, such as top p and temperature:

https://github.com/Azure-Samples/chat-with-your-data-solution-accelerator/blob/54723fe9b13baf1096abff135c67a98fcdf1a2cb/code/create_app.py#L96-L160

These should be added to the custom endpoint, to create a consistent experience when switching between the two endpoints.

Requirements

A list of requirements to consider this feature delivered

  • Add all relevant Azure OpenAI env vars from the BYOD endpoint to the custom endpoint

Tasks

To be filled in by the engineer picking up the issue

cecheta avatar May 20 '24 08:05 cecheta