promptfoo icon indicating copy to clipboard operation
promptfoo copied to clipboard

Truncated Test Name in CLI Progress Bar

Open arsena opened this issue 8 months ago • 1 comments

Describe the bug The CLI progress bar doesn't display enough characters to see which test is being run.

To Reproduce Run promptfoo eval

Sample Configuration:

description: "Promptfoo test cases for different stories"
prompts:
  - ./test/promptfoo/common/prompts.mjs:a
  - ./test/promptfoo/common/prompts.mjs:b
providers:
  - id: file://./test/promptfoo/providers/MockAppProvider.mjs
    label: "MockApp"
defaultTest:
  options:
    provider:
      id: file://./test/promptfoo/providers/CustomGPTProvider.mjs
      label: "CustomGPT"
      config:
        api_version: "2024-02-01"
        chat_completions_model: "gpt-4o"
        embeddings_model: "text-embedding-ada-002"
        temperature: 0.7
        max_tokens: 2000
  assert:
    - type: answer-relevance
      threshold: 0.7
tests:
  - file://./test/promptfoo/*-stories.*
outputPath: ./test-reports/promptfoo/promptfoo-result.json
evaluateOptions:
  maxConcurrency: 8

Expected behavior Expected more characters reserved for displaying variables, because our vars contain the input differences. Therefor displaying more vars would indicate better which test is being run.

Screenshots

Image

System information:

  • Promptfoo version: 0.107.7

arsena avatar Apr 24 '25 22:04 arsena

BTW Promptfoo is excellent.

arsena avatar Apr 24 '25 22:04 arsena

@sklein12 implemented a small fix for this issue, would appreciate your thoughts on this!

adityabharadwaj198 avatar Jul 24 '25 12:07 adityabharadwaj198