Long Response times in App

[baerensau]

Hi, we have the problem that our app service has very bad response times (according monitoring from 20ms up to 40s!). So when the website is reloaded it takes often very long. The app service is running on Azure plan S2.

[dmbuk]

+1 , we have the same issue, the app response times are too high, sometimes hitting 30 - 40 seconds. The ASP is Premium v2 P3V2, single instance.

[sarah-widder]

Hi folks, please see this section in the readme: https://github.com/microsoft/sample-app-aoai-chatGPT?tab=readme-ov-file#scalability You may be able to improve performance of your app by updating the gunicorn settings to have multiple threads and workers. Additionally #460 should improve response time when multiple users are accessing the app.

[dmbuk]

Thanks @sarah-widder for the suggestion. We have a UAT copy of the app (using the same AI and Search), it has no users, but response times are still too high. Here it took 1.8 minute:

No changes have been made recently to the app or backend services. Any advice?

[nrishoj]

@dmbuk, @sarah-widder - Did you manage to figure out an approach/solution to reduce the response times? We've tried running various production sized ASPs, without luck.