Michael
Michael
Hi @dmockingbird551, thanks so much for bringing this up and for your patience! We fixed the issue by adding a Python runtime to the Docker image as part of [this...
Hi @justdigi, apologies for the confusion! I added Python support in #1519 but we removed it in #1599. I’ll re-add it and test it now. Thanks for your patience, and...
The fix is in https://github.com/promptfoo/promptfoo/pull/1677. I’ve also added checks in the CI to make sure Python stays in the image going forward. Thanks so much for your patience and for...
Hi @MatanYadaev, We’ve just released [0.85.0](https://github.com/promptfoo/promptfoo/releases/tag/0.85.0), which includes changes to how Nunjucks templating is handled only in the grader context (overriding the disable option just for those cases). Please give...
This is a good idea. The llm-rubric grading prompt needs some work. There are a lot of false positives. We can either try to improve the grading prompt or close...
Closing as stale
Hi @rrbanda! Thanks for suggesting this change! We would welcome this as an alternative Dockerfile in a new docker folder. If you're up for PRing it yourself, could you create...
Hi @rrbanda, thanks again for your suggestion! As there hasn’t been much recent activity, I’ll go ahead and close this issue for now. If you’re still interested in adding this...
Thank you for raising these issues (and many others), @aisonym. I appreciate your feedback and insights into how you're using promptfoo. You've made some excellent points regarding the CSV output...
Thanks for the config! I am about to reproduce your issue. We have two different csv export mechanisms (one via the cli and one in the webui). I'll work on...