Multimodal
MARINE object-hallucination evaluation: per-item outputs for LLaVA-v1.5-7B with and without the MARINE image-grounded guidance intervention, on POPE (binary object probing) and CHAIR (caption hallucination) over MSCOCO images.
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Scale: 1 = correct · 0 = incorrect
Sample items
[Image: COCO_val2014_000000278890.jpg] Is there a handbag in the image?
How subjects answered
Yes, there is a handbag in the image, and a person is holding it.
Yes, there is a handbag in the image, and a person is holding it.
[Image: COCO_val2014_000000320350.jpg] Is there a backpack in the image?
How subjects answered
Yes, there is a backpack in the image, and the man and woman are wearing it while skiing.
Yes, there is a backpack in the image, and it is being worn by the man.
[Image: COCO_val2014_000000110449.jpg] Is there a tv in the image?
How subjects answered
Yes, there is a TV in the image, and the two men are standing in front of it.
No, there is no TV in the image. The image only features a person wearing headphones and a hat.
[Image: COCO_val2014_000000046919.jpg] Is there a car in the image?
How subjects answered
No, there is no car in the image. The image features a person skiing on a snow-covered slope.
No, there is no car in the image. The image only shows a person on skis and a snowy mountain.
[Image: COCO_val2014_000000067042.jpg] Is there a person in the image?
How subjects answered
Yes, there is a man in the image.
Yes, there is a person in the image.
[Image: COCO_val2014_000000477016.jpg] Generate a short caption of the image.
How subjects answered
A little girl is standing in front of a toy oven, looking at the fish inside.
A little girl is standing in front of a toy oven, which has a fish tank inside.
[Image: COCO_val2014_000000456784.jpg] Is there a knife in the image?
How subjects answered
Yes, there is a knife in the image.
Yes, there is a knife in the image.
[Image: COCO_val2014_000000411564.jpg] Is there a person in the image?
How subjects answered
Yes, there is a person in the image, a man who is sitting on a table or counter.
Yes, there is a person in the image.
[Image: COCO_val2014_000000268293.jpg] Is there a person in the image?
How subjects answered
Yes, there is a man in the image who is playing tennis.
Yes, there is a person in the image.
[Image: COCO_val2014_000000358086.jpg] Generate a short caption of the image.
How subjects answered
A woman in a green shirt and shorts is jumping in the air to catch a frisbee.
A woman in a green shirt and shorts is jumping in the air to catch a frisbee.
[Image: COCO_val2014_000000250540.jpg] Is there a truck in the image?
How subjects answered
No, there is no truck in the image. The image features a group of people on motorcycles.
No, there is no truck in the image. The image only contains a person and a motorcycle.
[Image: COCO_val2014_000000523175.jpg] Is there a person in the image?
How subjects answered
No, there is no person in the image. It is a close-up of a bowl of soup with a spoon in it.
No
Subjects