Medicine
OpenBioRQ
OpenBioRQ: 657-question core of unsolved biomedical research questions for tool-using agents, graded by a frozen per-question checklist; solve = checklist score >= 0.5. Full per-(model x item) matrix released for 11 agents (roster, held-out, frontier, no-tool ablations).
657items
11subjects
CC-BY-4.0license
medicinedomain
sciencedomain
agents_and_tool_usedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect