Michael

feat: Add web search assertion type

4

## Summary This PR adds a new `web-search` assertion type to promptfoo, enabling quick verification of current information using web search capabilities across multiple providers. ## Changes ### Core Implementation...

feat(webui): add cloud status indicator to navbar

6

## Description Adds a cloud status indicator to the navigation bar showing users their Promptfoo Cloud connection status. ## Changes - **Backend**: Added `/api/user/cloud/status` endpoint - **Frontend**: New CloudStatusIndicator component...

feat: add output handler support with file:// prefix and extension-based inference

1

Closes #4754 Allows JavaScript and Python functions to process evaluation results programmatically instead of just saving to files. ## Changes - Support `file://` prefix for output handlers - Infer handler...

fix(webui): prevent horizontal scrolling in metadata table

3

## Summary This PR fixes horizontal scrolling issues in the metadata Key/Value table that occurred when displaying long URLs, JSON strings, or other lengthy content. ## Changes - Added `tableLayout:...

feat: add includeSafe option to test guardrails for over-blocking

2

## Summary Add `includeSafe` configuration option to BeaverTails, UnsafeBench, and Aegis plugins to test whether guardrails incorrectly block legitimate, safe requests (over-blocking/false positives). ## Key Features - 50/50 balanced split...

feat(vlguard): Update to use original VLGuard dataset with performance improvements

2

## Summary Updates the VLGuard plugin to use the original VLGuard dataset (ys-zong/VLGuard) instead of the derivative dataset, with performance optimizations and backwards compatibility. ## Changes ### Dataset Migration -...

feat: cli auto-updater

2

# CLI Auto-Updater This PR adds a comprehensive auto-update system for the promptfoo CLI, enabling both manual and automatic background updates across all installation methods and platforms. ## 🎯 Overview...

fix: add data URL support for vision models with local images

2

## Summary Fixes Azure OpenAI Vision models failing with "Invalid image URL" errors when using local images via `file://` syntax. Azure OpenAI Vision requires data URLs (`data:image/jpeg;base64,`) but promptfoo was...

revert: remove redundant retry functionality

2

## Summary Remove the retry command and `--retry-errors` flag functionality that was added in #5647, as it is redundant with existing filtering capabilities. ## Problem Analysis The retry functionality provided...

feat(a11y): improve accessibility - fix critical WCAG issues

1

## Summary First phase of comprehensive accessibility improvements based on thorough audit. This PR fixes **all 6 critical accessibility issues** that were blocking WCAG 2.1 Level A compliance. ## Audit...