Safety
Anthropic Red Team
Anthropic Red Team tests whether models avoid complying with adversarial prompts taken from human red teaming conversations, with a safety classifier judging each response as safe or unsafe.
995items
81subjects
Apache-2.0license
safetydomain
textmodality
item-level responses released
Saturation status: Yes
Response matrix
Responses come from Stanford CRFM's HELM Safety leaderboard (v1.17.0), which reuses the transcripts as a static item bank; the original release instead records attacks against Anthropic's own 12 model configurations.
Rasch analysis p = σ(θ − z)
81,000 responses, 80/20 split over cells · 81 subjects · 995 items
AUC train
0.948
AUC test
0.921
Loading session strips…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect