Model responds with I don't know.

[samin-batra]

Please provide us with the following information:

This issue is for a: (mark with an x)

- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

I have tied this application to my own dataset. When I ask it questions on some temperature configurations, it responds with "I don't know". However, when I copy the retrieved content, and the question, in the same prompt format, to the chat playground in Azure and I use the same temperature configurations, I get an answer. This keeps happening sporadically.

Any log messages given by the failure

Not an error

Expected/desired behavior

It should answer with the relevant content.

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?) Windows 10

azd version?

run azd version and copy paste here.

azd version 1.7.0 (commit 49d6adc2efb178083f61822e6b4715258560803d)

Versions

Mention any other details that might be useful

I noticed this was happening with the sample dataset as well.

---

Thanks! We'll be in touch soon.

[pamelafox]

Have you already read our guide on debugging answer quality?

https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/customization.md#improving-answer-quality

The first step is to determine whether the issue is with it not finding the search results.