Michael

@fvdnabee this is working now! Feel free to re-open if you have any questions. Check out our ts example here: https://github.com/promptfoo/promptfoo/tree/main/examples/ts-config

Check out this example: https://github.com/promptfoo/promptfoo/tree/main/examples/f-score and let us know if you have any other questions!

Hi @EdwardSanglayGarcia and everyone who participated in this discussion! Excellent news - `systemInstruction` is now fully supported for Gemini providers! You can use it like this: ```yaml providers: - id:...

What if we add structured outputs on the generation model?

Closing as stale! Thanks @typpo!

Awesome @adityabharadwaj198! I just opened a PR with guidance on adding a new assertion: https://github.com/promptfoo/promptfoo/pull/3610 Please feel free to leave comments on the PR if you think parts of it...

Hi @sinedied, I recently merged [PR #1654](https://github.com/promptfoo/promptfoo/pull/1654), which normalizes the flags—you can now use both --env-file and --env-path interchangeably in the next release. Regarding automatically searching up the folder hierarchy...

Hi @ktalebian, we'll look into adjusting the behavior so that providers are only instantiated after filtering. As a potential workaround, you could delay loading the custom provider library until the...

Hi @sbichenko, Sorry for not closing this sooner - this has been working since **PR #2709** was merged back in March 2025 (version 0.107.5). You can add metadata columns to...

Hey @dhodun, this is a great idea! We’d love to support this, and if you’re interested in contributing, I would be more than happy to help guide you through it....