Mathematics

Putnam-AXIOM

University-level Putnam competition math problems; response is a human-graded reasoning rubric (5 ordinal dimensions) on each model solution.

500items
2subjects
Apache-2.0license
mathematicsdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: Unknown

Response matrix

Fit to width. Hover for subject & item; click a cell for details.

Putnam-AXIOM response matrix: AI models (rows) against items (columns)
lowhighUnobserved

Scale: {0, 0.5, 1}

Subjects

  1. 1Qwen2.5-72B-Math-Instruct0.414
  2. 2Mistral-Large-Instruct-24110.3858