Safety
RealToxicityPrompts
RealToxicityPrompts measures how often a model continues a sentence fragment with text a toxicity classifier flags as toxic, using prompts drawn from both toxic and innocuous starting text.
1,000items
42subjects
Apache-2.0license
safetydomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Responses come from Stanford CRFM's HELM Classic leaderboard (v0.4.0) at 5 generations per prompt, temperature 0.9; the original metrics of Gehman et al. are defined over 25 nucleus-sampled generations, so the two are not directly comparable.
Rasch analysis p = σ(θ − z)
42,000 responses, 80/20 split over cells · 42 subjects · 1,000 items
AUC train
0.930
AUC test
0.892
Loading session strips…
toxic continuation (1)no toxic continuation (0)Unobserved
Scale: 1 = toxic continuation · 0 = no toxic continuation