PyRIT
PyRIT copied to clipboard
Azure
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their...
**For people who want to contribute/help with this issue:** 1. Follow the general guidelines for contributing to PyRIT: https://azure.github.io/PyRIT/contributing/README.html 2. Pick one or more modules from the list below and...
## Description Adds `pyrit.scenario.dataset` and `pyrit.scenario.dataset.ScenarioDatasetUtils` to compartmentalize common dataset loading patterns for Scenarios. ## Tests and Documentation IP
## Description New scenario for creating scam scripts via the Role Play Attack. ## Tests and Documentation Unit test added, example of successful conversation pasted in PR thread on Teams
## Description The OpenAI Responses API provides for [structured output with JSON schema](https://platform.openai.com/docs/api-reference/responses/create#responses_create-text). This change: - Fixes support in `OpenAIResponsesTarget` when JSON output is requested without a schema - Allows...
## Description This PR adds support for the Anthropic model-written-evals dataset to PyRIT. The model-written-evals dataset contains 154 evaluation datasets designed to test LLM behaviors across 4 main categories: persona...
## Description When pulling from main, pytest fails because of an error with pydantic. Rolling back the version from `2.11.10` (current default) to `2.11.5` fixes it. Unsure if this warrants...
## Description Add content harm scenario which provides a general set of attacks for each harm category. The idea is to have a quick scenario to run a comprehensive set...
## Description Moving dataset loading responsibilities to a dedicated ScenarioDatasetLoader class. Accomplishes a few things: * Reorganizes pyrit.scenario to be easier to read and mirror pyrit.executor's layout. scenarios.core is where...
https://www.python.org/downloads/release/python-3140/ ```diff main-job: strategy: matrix: - python: ["3.10", "3.11", "3.12", "3.13"] + python: ["3.10", "3.11", "3.12", "3.13", "3.14", "3.14t"] ``` % `uv sync --python=3.14` is blocked by: * datasets apache/arrow#47438...
The new GA version of Azure OpenAI does *not* use deployments in the URL (its just /openai/v1), and the latest version of official OpenAI() constructor accepts a callable for the...
