Michael
Hi @SysOverdrive, Thanks for reporting this issue and for being such a power user of promptfoo! I'm sorry we haven't been able to address it yet, but it's on our...
Hi @mpasternak, Thank you for the kind words and for suggesting this great idea! We'll add this feature request to our backlog, though it may take some time before we...
@ImTheDeveloper @mpasternak this is being worked on in https://github.com/promptfoo/promptfoo/pull/2214 It will go in soon!
Finally circling back to close this one out - this has been implemented for a while now! For retrying only errors (network/API issues, not test failures): `--filter-errors-only latest` or `--retry-errors`...
Hi @gregoryboue and @eharris128, this has been fixed in #5375 (v0.118.10). Thanks for the report and sorry it took a while! Verified that `evaluateOptions` now works with custom config filenames...
Hi @moltar, generically overriding the database path and credentials would be a great addition to promptfoo, and we’d welcome a PR to implement this change. If you decide to proceed,...
@moltar would you like help getting this in?
Thanks @albertlieyingadrian!
Hi @moltar, thanks for bringing this up! I’m currently looking into potential solutions to address this, including exploring ways to make these dependencies optional or restructuring how they’re managed. I've...
Thanks for raising this @moltar, and to @aloisklink for the `peerDependenciesMeta` suggestion. This has been addressed in #5948 - we moved the provider-specific dependencies from peer to optional. This means...