PyRIT
PyRIT copied to clipboard
Azure
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their...
#### Is your feature request related to a problem? Please describe. The paper https://arxiv.org/pdf/2310.09624.pdf mentions - Semantically Aligned augmentation (which seems similar to our prompt variation generation) - Targeted Bootstrapping...
## Description - Adding a function to pretty print RedTeamingOrchestrator output - Fixing a bug so RTO scorers are added in a way that ties them to prompts - Small...
## Description Add jailbreak prompt templates from following papers: 1. [A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily](https://arxiv.org/abs/2311.08268) - Code nesting - Table...
## Description - Added pre-commit hook to check for broken links - Created Contributing Section and broke up the contributor guide - Updated exception handling recommendations - Added testing documentation...
## Description Added Exception Handling to OpenAIChatInterface ## Tests and Documentation Added unit tests in the test_openai_chat_target file to ensure exception handling works
_Originally posted by @rlundeen2 in https://github.com/Azure/PyRIT/pull/189#discussion_r1605593364_ This would help in streamlining the creation of the scorer without having to specify both the objective of the red teaming orchestrator + scorer....