Michael
The pattern introduced in #2993 is a good one to follow and yes we could definitely abstract readStandaloneTestsFile to also support passing context. This is a really great idea. If...
Thanks for reporting this @DarioBernardo! Relates to https://github.com/promptfoo/promptfoo/issues/1701
@vedantr would you mind taking a look at this if you have time? Don't worry if not.
Thanks for the contribution @gonzab! Could you include a minimal promptfooconfig example to help test this? I can handle adding tests etc.
Thank you so much and sorry for the delay. I implemented this as a context arg. I hope that is ok.
@ellipsis-dev review
You can override the redteam provider in your config with ```yaml redteam: plugins: ... provider: `openouter:deepseek-r1` ``` for example. Who is hosting deepseek for you?
Hi @sjsinju, Thank you for your suggestion! We currently don't have built-in support for marking test cases as "skipped" directly. However, you can achieve similar functionality by implementing custom assertions...
Hi @tianzhich, have you tried using the Table Settings option in the eval web page? There is an option to Render model outputs as Markdown. If this doesn’t fully address...
Great suggestion! I'll add customizing the default font size / overriding styles to our backlog for future improvements.