Mathematics
NaturalReasoning
NaturalReasoning: 2.8M challenging reasoning questions backtranslated from pretraining corpora, spanning mathematics, physics, computer science, and economics/social sciences. Each question carries a reference answer and model-generated responses (Llama-3.3-70B-Instruct).
143,048items
1subjects
CC-BY-NC-4.0license
reasoningdomain
mathematicsdomain
sciencedomain
textmodality
item-level responses released
Saturation status: Unknown
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect