Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: Add SorryBench Dataset #707

Open
jbolor21 opened this issue Feb 12, 2025 · 0 comments
Open

FEAT: Add SorryBench Dataset #707

jbolor21 opened this issue Feb 12, 2025 · 0 comments
Labels
datasets Pulling in external datasets into PyRIT enhancement New feature or request good first issue Good for newcomers

Comments

@jbolor21
Copy link
Contributor

This dataset should be available within PyRIT: https://huggingface.co/datasets/sorry-bench/sorry-bench-202406)
Associated paper: https://arxiv.org/pdf/2502.04322v1

[[Content Warning: Prompts are aimed at provoking the model, and may contain offensive content.]]
Additional Disclaimer: Given the content of these prompts, keep in mind that you may want to check with your relevant legal department before trying them against LLMs.
@jbolor21 jbolor21 added datasets Pulling in external datasets into PyRIT enhancement New feature or request good first issue Good for newcomers labels Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
datasets Pulling in external datasets into PyRIT enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jbolor21