awesome-testing icon indicating copy to clipboard operation
awesome-testing copied to clipboard

Add AI & LLM Testing section with promptfoo

Open mldangelo opened this issue 3 weeks ago • 0 comments

Adds a new AI & LLM Testing section to the Software category.

As LLM-powered applications become more prevalent, testing frameworks specific to AI are increasingly important. This PR adds:

  • promptfoo - Open-source framework for testing and red teaming LLM applications

promptfoo enables testers to:

  • Compare prompts and evaluate model outputs systematically
  • Test RAG architectures for accuracy and relevance
  • Run multi-turn adversarial attacks to find jailbreaks and prompt injection vulnerabilities
  • Integrate security testing into CI/CD pipelines

Used by 250K+ developers and featured in OpenAI Build Hours and Anthropic's courses.

mldangelo avatar Dec 09 '25 15:12 mldangelo