phoenix
phoenix copied to clipboard
[ENHANCEMENT] Add eval template text as a field in addition to name, label, score, explanation
Is your feature request related to a problem? Please describe. When I run evals and log them to phoenix, it would be nice to see what the eval template associated with the eval was used
Describe the solution you'd like
Hey @gabe0912 thanks for the issue! Makes sense from a visibility perspective however there are a few things data model wise that this ultimately may not make sense as we are adding tracing for evals eminently. In this case the eval could link to the trace that generated it, which ultimately would help you debug evaluation runs.
Another thing we will be working on is adding metadata about a run. That could ultimately contain the model config and template