[Dev UI] 'Re-run evaluation' button on evaluation details page
Overview
Provide a button to re-run evaluation when viewing eval run details.
User goal(s)
Easy way to retry evaluations without filling the run-eval form again.
Requirements
Acceptance Criteria
- 1 Button to rerun evaluation on eval details page.
- 2 Autofill current eval config (dataset, actionRef, metrics and actionConfig)
You can add a similar button as the "Run evaluation" button at the top right corner of the eval results page, in line with the eval name heading:
but with the "refresh" icon and the text "Re-run evaluation"
I have a few questions:
- Do we need to take the user back to run eval page or re-run on the eval results page?
- What if a file was used instead of dataset to run the eval.
- where can I find the batch size?
@shrutip90 @ssbushi
Tagging @mjchristy for UX.
- Good question. Maybe have a button + menu, which default to rerun, and the drop down could let them go to the run eval page for changing the config. Something like this:
-
Disable rerun eval (or take them to the run eval page).
-
Batch size is not part of the eval metadata yet. Ignore it for now, I will add it once ready. (Please file an issue for that)