PyRIT
PyRIT copied to clipboard
Azure
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their...
## Description This PR adds support for the JailbreakV_28k dataset to PyRIT. One notable departure from multimodal dataset fetching present here is that we need a local download of the...
## Description Adding notebook for red teaming for psyschosocial harms using a multi-step approach of modeling user behaviors, contexts, and evaluations * Created new conversation scorer to score the entire...
#### Is your feature request related to a problem? Please describe. There is currently no orchestrator in PYRIT that is implementing the Generative Offensive Agent Tester ([GOAT](https://arxiv.org/abs/2410.01606)) attack to be...
Hi Guys, I am trying to figure out how I can use PyRIT to test out a custom chatgpt (using the openai gpt builder) built and if it is possible...
## Description In order to make `harm_categories` easier to search through and group by some alias names, this PR refactors our previous `String` harm categories into a class `HarmCategory` with...
#### Describe the bug The title has all the information. I ran into this because the default is `False` and my objective score wasn't getting printed. #### Expected Results objective...
## Description ## Tests and Documentation
#### Is your feature request related to a problem? Please describe. When red teaming agentic systems with multiple tools, APIs, and permission boundaries, PyRIT lacks visibility into the system architecture....
## Description Enables iterative, multi-turn attack strategies with minimal changes. Byproduct of attempt to create a multi-branch attack during the Hackathon. The current execute_with_context_async and _perform_async methods defined by Strategy...
### Update This PR fixes Issue #1096: - Objective scores are now always displayed. - Auxiliary scores are only shown if explicitly requested. ### Related Issue Fixes #1096
