Safety
SORRY-Bench
SORRY-Bench measures whether models comply with or refuse unsafe requests, with human annotators labeling each reply, including when the request is rewritten in styles such as role play, slang or a cipher.
450items
31subjects
otherlicense
safetydomain
textmodality
item-level responses released
Saturation status: Yes
Response matrix
Sparse human-annotated sample over the (model x prompt x style) cube.
Rasch analysis p = σ(θ − z + c)
7,200 responses, 80/20 split over cells · 31 subjects · 450 items · 19 conditions
8 of 31 subjects answered every item alike, so their θ is unbounded and sits pegged to the column edge.
AUC train
0.922
AUC test
0.883
Loading session strips…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect