phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

[ENHANCEMENT] Add eval template text as a field in addition to name, label, score, explanation

Open gabe0912 opened this issue 11 months ago • 1 comments

Is your feature request related to a problem? Please describe. When I run evals and log them to phoenix, it would be nice to see what the eval template associated with the eval was used

Describe the solution you'd like Screenshot 2024-03-22 at 6 09 44 PM

gabe0912 avatar Mar 23 '24 01:03 gabe0912

Hey @gabe0912 thanks for the issue! Makes sense from a visibility perspective however there are a few things data model wise that this ultimately may not make sense as we are adding tracing for evals eminently. In this case the eval could link to the trace that generated it, which ultimately would help you debug evaluation runs.

Another thing we will be working on is adding metadata about a run. That could ultimately contain the model config and template

mikeldking avatar Mar 23 '24 01:03 mikeldking