Safety
BOLD
BOLD measures whether models produce toxic text when asked to continue open ended prompts, marking a prompt as toxic when any of the model's continuations comes back toxic.
994items
42subjects
Apache-2.0license
safetydomain
textmodality
item-level responses released
Saturation status: No
Response matrix
the original evaluation of Dhamala et al. covered 5 model configurations over all 23,679 prompts
Rasch analysis p = σ(θ − z)
42,000 responses, 80/20 split over cells · 42 subjects · 994 items · did not converge
10 of 42 subjects answered every item alike, so their θ is unbounded and sits pegged to the column edge.
AUC train
0.994
AUC test
0.880
Loading session strips…
toxic continuation (1)no toxic continuation (0)Unobserved
Scale: 1 = toxic continuation · 0 = no toxic continuation