Michael

Deployed in [0.69.1](https://github.com/promptfoo/promptfoo/releases/tag/0.69.1). See https://github.com/promptfoo/promptfoo/tree/main/examples/jest-integration Thanks @MentalGear!

@MatanYadaev We support a version of this (but it may not be working). Check out: https://github.com/promptfoo/promptfoo/blob/main/site/docs/usage/command-line.md?plain=1#L165 and https://github.com/promptfoo/promptfoo/blob/main/src/commands/eval.ts#L276 Let me know if it doesn't resolve your immediate issue. The conditional...

Hi @MatanYadaev, I wanted to let you know that the feature has been released in [version 0.78.3](https://github.com/promptfoo/promptfoo/releases/tag/0.78.3). As discussed in #1443, you can set the global pass rate threshold per...

> Amazing @mldangelo! WDYT about allowing the user to configure the pass rate threshold inside the configuration, instead of in an environment variable? In my use case, I have many...

Hi @MatanYadaev and @kaiktl, I believe @typpo has addressed the issue you reported. Please try running the latest version of promptfoo. If the problem persists, feel free to re-open this...

Hey @SysOverdrive, thanks for the remote-pdb suggestion and for your patience! I just added some notes about debugging in https://github.com/promptfoo/promptfoo/commit/41cc82b2489efce4b167ebb25cc8cc6bcaf667b9, which should help clarify how to debug custom Python providers....

Thank you for your suggestion, @crivano. This is a great idea and has been requested by other users as well (including myself). Implementing this feature involves making modifications across multiple...

Thanks @QuarkNerd! Would you mind moving the type annotations into your package as well? I started a ts rewrite of rouge a few months ago: https://github.com/mldangelo/rouge you are free to...

@QuarkNerd can you give mdangelo permissions to modify your npm package?

Thanks, @QuarkNerd for suggesting this and driving it! I switched it over to a ts fork https://github.com/promptfoo/rouge hosted at promptfoo! Happy to add you as a contributor to the ts...