kubectl-ai
kubectl-ai copied to clipboard
Add eval for finding application-level failures
Adds find-application-level-failures eval. The goal of this eval is to cover the case of the agent troubleshooting past a healthy k8s environment, but some application-level failures are apparent in the logs. • runs eval-app.py python script that logs successes and errors • prompts the agent to check for anything wrong, expects 'division by zero' to be outputted.
one more comment, about the directory of the task, can we rename it to debug-app-logs