Mathematics
JETTS
JETTS released generator response pool: per-(generator model, query) correctness over 7 math/code/instruction-following datasets, 10 samples per query.
5,135items
8subjects
apache-2.0license
mathematicsdomain
software_engineeringdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: Unknown
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect
Subjects
- 1Qwen2.5-72B-Instruct0.7108
- 2Qwen2.5-Math-7B-Instruct0.7084
- 3Qwen2.5-32B-Instruct0.6805
- 4Llama-3.1-70B-Instruct0.6253
- 5Qwen2.5-Coder-7B-Instruct0.4857
- 6Llama-3.1-8B-Instruct0.4736
- 7deepseek-math-7b-instruct0.464
- 8deepseek-coder-6.7b-instruct0.4257