Science & Engineering
VLM4Bio: evaluating pretrained vision-language models for trait discovery from biological images (Bird/Butterfly/Fish). This build covers the multiple-choice (selection) species-classification task, where the model picks the correct scientific name from four options given an organism image.
Response matrix
Each row is an AI model and each column an item, ordered so the strongest models and easiest items gather toward one corner. 1 subjects × 1,242 items, 100% of cells evaluated.
Fit to width. Hover for subject & item; click a cell for details.
Scale: 1 = correct · 0 = incorrect
Sample items
A spread of items across the difficulty range, each shown with a few subjects' actual answers.
What is the scientific name of the bird in the image? Options: A) Setophaga discolor, B) Setophaga citrina, C) Setophaga castanea, D) Setophaga pensylvanica. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: A) Setophaga discolor.
What is the scientific name of the fish in the image? Options: A) Lepomis auritus, B) Percina phoxocephala, C) Alepes djedaba, D) Notropis dorsalis. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: A) Lepomis auritus.
What is the scientific name of the fish in the image? Options: A) Notropis aguirrepequenoi, B) Caranx sexfasciatus, C) Catostomus catostomus, D) Notropis braytoni. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: B) Caranx sexfasciatus.
What is the scientific name of the fish in the image? Options: A) Crenimugil crenilabis, B) Atrosalarias holomelas, C) Notropis percobromus, D) Esox lucius. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: A) Crenimugil crenilabis.
What is the scientific name of the fish in the image? Options: A) Notropis heterodon, B) Notropis buchanani, C) Cottus bairdii, D) Notropis buccatus. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: D) Notropis buccatus.
What is the scientific name of the fish in the image? Options: A) Fundulus zebrinus, B) Neogobius melanostomus, C) cyprinella whipplei, D) Morone chrysops. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: B) Neogobius melanostomus
What is the scientific name of the fish in the image? Options: A) Parablennius yatabei, B) Acropoma hanedai, C) Notropis cummingsae, D) Rhinichthys obtusus. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: D) Rhinichthys obtusus.
What is the scientific name of the fish in the image? Options: A) Cyprinella formosa, B) Takifugu alboplumbeus, C) Lepomis cyanellus, D) Notropis nazas. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: C) Lepomis cyanellus
Each biological species has a unique scientific name composed of two parts: the first for the genus and the second for the species within that genus. What is the scientific name of the fish in the image? Options: A) Notropis hudsonius, B) Esox americanus, C) Notropis buccatus, D) Lepomis humilis. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: B) Esox americanus
What is the scientific name of the fish in the image? Options: A) Carassius carassius, B) Cottus asperrimus, C) Ilisha , D) Praealticus tanegasimae. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: D) Praealticus tanegasimae.
What is the scientific name of the fish in the image? Options: A) Notropis bifrenatus, B) Lepomis symmetricus, C) Lepomis F2, D) Ameiurus melas. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: A) Notropis bifrenatus.
What is the scientific name of the fish in the image? Options: A) Percopsis transmontana, B) Lepomis macrochirus, C) Sardinella gibbosa, D) Thryssa baelama. Write the answer after writing 'The answer is: '.
How subjects answered
The answer is: B) Lepomis macrochirus
Subjects
1 subjects, ranked by mean response (accuracy) across this benchmark's items.