Task Adherence evaluator doesn't show variables for ground_truth and tool_calls
This doesn't show all of the variables expected in the dataset. For example, the sample dataset is:
Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.
The sample dataset is fixed and always includes ground_truth, regardless of which evaluators are selected.
Task Adherence evaluator doesn't require ground_truth and tool_calls: https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/develop/agent-evaluate-sdk#-evaluate-other-agents
This issue has been automatically marked as stale because it has been marked as requiring author feedback but has not had any activity for 7 days. It will be closed if no further activity occurs within 3 days of this comment. If it is closed, feel free to comment when you are able to provide the additional information and we will re-investigate.