kubectl-ai icon indicating copy to clipboard operation
kubectl-ai copied to clipboard

Add eval for finding application-level failures

Open noahlwest opened this issue 7 months ago • 1 comments

Adds find-application-level-failures eval. The goal of this eval is to cover the case of the agent troubleshooting past a healthy k8s environment, but some application-level failures are apparent in the logs. • runs eval-app.py python script that logs successes and errors • prompts the agent to check for anything wrong, expects 'division by zero' to be outputted.

noahlwest avatar May 31 '25 01:05 noahlwest

one more comment, about the directory of the task, can we rename it to debug-app-logs

droot avatar Jun 02 '25 17:06 droot