Mathematics
MATH-Vision
MATH-Vision (MATH-V): 3,040 competition mathematics problems with visual context, spanning 16 mathematical subjects and 5 difficulty levels. A model passes a problem iff its final answer matches the gold answer.
3,037items
13subjects
MITlicense
mathematicsdomain
imagemodality
textmodality
item-level responses released
Saturation status: Unknown
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect
Subjects
- 1GPT-4V0.2337
- 2Gemini-Pro0.16
- 3InternLM-XComposer2-VL0.1446
- 4SPHINX-MoE0.1418
- 5Qwen-VL-Max0.1411
- 6ShareGPT4V-13B0.1187
- 7LLaVA-v1.5-13B0.1112
- 8Qwen-VL-Plus0.1072
- 9GPT-40.1061
- 10ShareGPT4V-7B0.1053
- 11ChatGPT-3.50.0974
- 12SPHINX-v20.097
- 13LLaVA-v1.5-7B0.0852