Software Engineering
Software World Models (DL4C'26)
Coding LLMs predict a runtime test outcome (passed/failed/error) for 435 library-level cases derived from SWE-bench Verified; response is per-item outcome-prediction correctness.
434items
18subjects
unknownlicense
software_engineeringdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect