chat-with-your-data-solution-accelerator
chat-with-your-data-solution-accelerator copied to clipboard
Include BYOD environment variables in custom endpoint
Motivation
There are a number of env vars used when using Azure OpenAI On Your Data in the BYOD endpoint, which are not used when calling the custom endpoint, such as top p and temperature:
https://github.com/Azure-Samples/chat-with-your-data-solution-accelerator/blob/54723fe9b13baf1096abff135c67a98fcdf1a2cb/code/create_app.py#L96-L160
These should be added to the custom endpoint, to create a consistent experience when switching between the two endpoints.
Requirements
A list of requirements to consider this feature delivered
- Add all relevant Azure OpenAI env vars from the BYOD endpoint to the custom endpoint
Tasks
To be filled in by the engineer picking up the issue