promptfoo
promptfoo copied to clipboard
Truncated Test Name in CLI Progress Bar
Describe the bug The CLI progress bar doesn't display enough characters to see which test is being run.
To Reproduce Run promptfoo eval
Sample Configuration:
description: "Promptfoo test cases for different stories"
prompts:
- ./test/promptfoo/common/prompts.mjs:a
- ./test/promptfoo/common/prompts.mjs:b
providers:
- id: file://./test/promptfoo/providers/MockAppProvider.mjs
label: "MockApp"
defaultTest:
options:
provider:
id: file://./test/promptfoo/providers/CustomGPTProvider.mjs
label: "CustomGPT"
config:
api_version: "2024-02-01"
chat_completions_model: "gpt-4o"
embeddings_model: "text-embedding-ada-002"
temperature: 0.7
max_tokens: 2000
assert:
- type: answer-relevance
threshold: 0.7
tests:
- file://./test/promptfoo/*-stories.*
outputPath: ./test-reports/promptfoo/promptfoo-result.json
evaluateOptions:
maxConcurrency: 8
Expected behavior Expected more characters reserved for displaying variables, because our vars contain the input differences. Therefor displaying more vars would indicate better which test is being run.
Screenshots
System information:
- Promptfoo version: 0.107.7
BTW Promptfoo is excellent.
@sklein12 implemented a small fix for this issue, would appreciate your thoughts on this!