Science
SuperGPQA
SuperGPQA asks graduate level multiple choice questions drawn from a wide range of academic disciplines, counting an answer correct only when the model picks the intended option.
26,529items
49subjects
CC-BY-NC-SA-4.0license
knowledgedomain
reasoningdomain
sciencedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Rasch analysis p = σ(θ − z)
1,299,921 responses, 80/20 split over cells · 49 subjects · 26,529 items
AUC train
0.851
AUC test
0.834
Loading session strips…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect