Safety
TruthfulQA-MC
TruthfulQA-MC tests whether models select the single true answer rather than a plausible falsehood, on questions built around misconceptions that people commonly repeat.
817items
150subjects
Apache-2.0license
safetydomain
knowledgedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Model panel capped to 150.
Rasch analysis p = σ(θ − z)
122,550 responses, 80/20 split over cells · 150 subjects · 817 items
AUC train
0.942
AUC test
0.942
Loading session strips…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect