Knowledge
IKP
IKP asks models factual questions that range from things almost anyone knows to extreme long tail trivia, counting refusals as wrong. Because accuracy tracks model size closely, it doubles as a way to estimate the parameter count of a closed model.
1,400items
170subjects
CC-BY-4.0license
knowledgedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect