Azure
FEAT Add Hendrycks/Ethics Dataset
Name: hendrycks/ethics
Link: https://huggingface.co/datasets/hendrycks/ethics
Relevant columns: "label","input"
Originally posted by @divyaamin9825 in #429
Describe the solution you'd like
This dataset should be available within PyRIT: https://huggingface.co/datasets/hendrycks/ethics Also available here: https://github.com/hendrycks/ethics Academic paper: https://arxiv.org/abs/2008.02275
Additional context
There are examples of how PyRIT interacts with other datasets here: https://github.com/search?q=repo%3AAzure%2FPyRIT%20%23%20The%20dataset%20sources%20can%20be%20found%20at%3A&type=code
[[Content Warning: Prompts are aimed at provoking the model, and may contain offensive content.]] Additional Disclaimer: Given the content of these prompts, keep in mind that you may want to check with your relevant legal department before trying them against LLMs.
