Mathematics
HARDMath2
HARDMath2: 210 graduate-level applied-mathematics problems (asymptotic series, boundary layers, integrals, nonlinear ODEs/PDEs, WKB) built by students. Per-(model, problem, sample) correctness from a SymPy-based equivalence checker across GPT and Gemini model families.
210items
9subjects
MITlicense
mathematicsdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: Unknown
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect
Subjects
- 1Gemini 2.5 Flash Thinking0.5604
- 2Gemini 2.5 Pro Preview0.5243
- 3GPT-o30.4476
- 4GPT-o10.3952
- 5GPT-o3-mini0.3524
- 6GPT-o4-mini0.311
- 7GPT-4.10.0577
- 8Gemini 2.0 Flash0.0474
- 9GPT-4o0.0333