Michael
Hi @QuarkNerd, thanks so much for your suggestion! Promptfoo already has a feature that might help with what you're looking for: the `--repeat` command. It doesn’t cache results at the...
Thank you @hoxworth! Can you make this editable? I will try to get some version of this in this week.
@coderabbitai review
Thanks @planger! Glad you're enjoying Promptfoo. Which provider are you currently using? That would help me provide more specific guidance for your use case. You've hit on an important topic...
Thanks for filing this @panozzaj! This bothers me too and is on my backlog. When I have more time, I’d like to address this by redoing the progress bars with...
Hi @delhicurry we'll get this fixed in the next release (tomorrow). In the meantime, I suggest individually specifying plugins. Sorry about the bug!
Closing as complete. Please give this a try @delhicurry and let us know if you encounter any other issues!
Re. loading model names, this should be supported now. You can try with `{{ env.YOUR_ENV_VAR_NAME }}`. For example `openai:chat:{{env.MODEL_NAME}}` For AZURE_API_VERSION we would gladly accept a PR to add support....
label attributes are rendered https://github.com/promptfoo/promptfoo/blob/main/src/providers.ts#L519-L520 but the id is not. We would gladly accept a PR if this is something you are interested in contributing. As a workaround you can...
Hi @AmineDjeghri, Thanks for this question! Good news - this feature already works in promptfoo. You can use template syntax to load model names from environment variables: ```yaml providers: -...