Science

Diagram Understanding (VLM diagram comprehension)

Diagram-understanding test suite for large vision-language models: multiple-choice questions about entities and relationships over synthetic icon-graph diagrams and real diagrams (physics, ecology, astronomy, geology, developmental biology, geochemistry). Per-item correctness for GPT-4o, GPT-4V and Gemini-1.5 under base and CoT prompting.