PyRIT
PyRIT copied to clipboard
Azure
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their...
## Description This is a draft for an experimental design proposal on how to orchestrate attacks. The idea is to modularize the components, separate the core attack algorithms and flows,...
#### Describe the bug A few methods in the memory interface don't scale beyond a few records. This is because they query by ID and have to insert all the...
#### Is your feature request related to a problem? Please describe. New dataset dropped that isn't available in PyRIT https://huggingface.co/datasets/promptfoo/CCP-sensitive-prompts #### Describe the solution you'd like We should add it...
# CBT-Bench Dataset Integration for PyRIT This pull request introduces support for the CBT-Bench dataset in PyRIT. The CBT-Bench dataset is a benchmark designed to evaluate the alignment and therapeutic...
## Description This PR introduces a new base class called `WordLevelConverter`, which simplifies the creation of word-level converters by providing a reusable foundation that standardizes word selection for transformation and...
The AI Recruiter is now fully functional with a FastAPI server, allowing us to upload PDFs and compare candidates’ résumés against job descriptions. The previous raw HTTP approach struggled with...
## Description Add support for converters to the Scanner. ## Tests and Documentation Unit tests added to verify converters that leverage LLMs, have required arguments, etc. are supported. Error cases...
## Is your feature request related to a problem? Please describe. I recently learned about the jailbreak method “H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models”,...
#### Adding this dataset of psychotherapy benchmark questions: https://huggingface.co/datasets/Psychotherapy-LLM/CBT-Bench #### Describe the solution you'd like: This dataset can be fetched and used in PyRIT!
[updating 3/10. The original is below the updated most recent design] In the database, we should have a new table named `ConversationAttack`. A single conversation can have N `ConversationAttack`s but...
