Software Engineering
ProgramBench
Published ProgramBench attempts to reconstruct executable behavior from a compiled program and its documentation, with native fractional behavioral-test scores and complete recorded agent trajectories.
1,316items
28subjects
The official registry declares MIT. The pinned result repositories do not declare redistribution terms; their captured inputs and derived tables remain local pending clarification. Referenced task programs and container contents retain their own upstream licenses.license
software_engineeringdomain
agents_and_tool_usedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Per-(model, task) outcomes for 12 models across 15 agent runs, on upstream's own Resolved / Almost-Resolved thresholds.
Loading response matrix…
lowhighUnobserved
Scale: Score in [0, 1]