General
FlySearch
FlySearch: object-goal navigation / exploration benchmark for VLMs in a photorealistic 3D UE5 simulation. A VLM pilots a drone via relative-move commands to find a described object. Scenario sets FS-1 (forest+city), FS-2 (harder city scenes) and FS-Anomaly; success measured per episode.
1,384items
10subjects
MITlicense
agents_and_tool_usedomain
textmodality
imagemodality
item-level responses released
Saturation status: Unknown
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect
Subjects
- 1Gemini 2.0 flash0.3983
- 2Claude 3.5 Sonnet0.2913
- 3GPT-4o0.2737
- 4Pixtral-Large0.2483
- 5Qwen2-VL 72B0.14
- 6Llava-Onevision 72B0.0917
- 7InternVL-2.5 8B MPO0.025
- 8Llava-Interleave 7B0.005
- 9Gemma 3 27B0.005
- 10Phi 3.5 vision0