Ian Webster

I think the right construction here is: ```yaml defaultTest: assert: - type: icontains-any value: '{{ entities }}' tests: '../testdata/data.csv' ``` The `defaultTest` object will apply to all test cases, and...

Ok, I see the problem! I went through the whole troubleshooting and debugging process (e.g. using `__expected`, wrapping in brackets) all of which you already explained in great detail :)...

Sorry for the delay here @alexclaydon - it's merged and will be in the next release!

Thanks for catching these errors! In the Typescript definition, [GradingResult](https://github.com/promptfoo/promptfoo/blob/main/src/types.ts#L340) expects a numeric `score` and a non-null `reason`. We should treat that as the source of truth because the rest...

Your PR is released in 0.62.0!

Maybe I'm misunderstanding the original request, but this is already possible using the "column selector"  It is true that this selection is not persisted though

Fix coming in #1095!

hey james :) it appears in the `Columns` menu for evals that have Descriptions

There isn't a way to suppress the warning, but I noticed something strange about your prompt. Are you intentionally including the literal string `"\n"`? If not you probably should use...

#2115 adds random sampling with `--filter-sample`!