sample-app-aoai-chatGPT
sample-app-aoai-chatGPT copied to clipboard
Issues in "use your data securely"
In this document: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/use-your-data-securely
It claims "If you plan to only secure part of your resources, you can skip the sections unrelated to your use case.". However, it is overclaimed. In fact, we have found in several cases if you miss some step, some seems-unrelated components are breaking.
Issue 1: Ingestion service undocumented logic
- Setup AzSearch skillsets using key auth if AOAI submit ingestion job is called using key auth.
- Setup AzSearch skillsets using managed identity if AOAI submit ingestion job is called without key (that means AAD auth).
As a result: without skillset managed identity, the AOAI trusted service won't work, then custom skill web api call will fail on AOAI network restriction, like below.
Issue 2: AOAI Studio undocumented logic
The key is not sent (thus using AAD auth) if the following conditions met:
- AOAI has system assigned managed identity.
- AOAI system assigned managed identity has data reader role on search resource.
- AOAI system assigned managed identity has service contributor role to search resource.
As a result: if some role assignments are missing, the AOAI submit ingestion job is called using key auth, and then chaining with issue 1, the ingestion job will fail.