Knowledge
CMMLU
Chinese multiple-choice knowledge questions with complete OpenCompass model predictions and a versioned reconstruction of option-extraction accuracy.
23,160items
22subjects
CMMLU questions use CC-BY-NC-SA-4.0; the OpenCompass prediction release does not declare a separate license.license
knowledgedomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect