Natan Yellin

One more comment on this: the "Show different only" view is very nice, but it's for comparing prompts not repeat runs on the same prompt.

I'm closing this, as its a bit too "general". I'll open issues with more specific ideas for improvement, starting with this. https://github.com/promptfoo/promptfoo/issues/992

@Zzzz1111 hi, can you share more details on what unique events you are trying to capture? `on_pod_all_changes` will fire every time that anything in the Pod's YAML changes, which tends...

Hi @josh-at-straker, The self-hosted UI is only available on our commercial plans. If you are interested, would love to setup a call and discuss! Feel free to reach out on...

Hi @tuananh-vpbank, We're planning to handle the CVEs soon, either by updating to the latest python or staying with python 3.9 and changing the base image. Hope to update soon!

And to answer your original question, I don't think there's a fundamental reason to stay w/ 3.9. Just requires testing and verifying that there isn't an issue with any of...

Yes, we plan to fix it in the next few weeks. I've discussed internally and we're prioritizing this.

I opened the other issue and a general purpose "group by" feature would solve the problem for me too. I add a variable to uniquely identify each test so one...

One more comment on this, as I've considered parsing the json output and building our own UI to show results. In the json output, there is currently nothing that you...