Software Engineering
AlgoTune
AlgoTune evaluates agents that optimize 154 numerical-programming tasks. This curation retains one published final speedup per task/model and the existing binary threshold: a finite final_speedup >= 1.0 is 1; a smaller finite speedup or the provider's explicit N/A is 0.
154items
18subjects
MITlicense
software_engineeringdomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect