Skip to main content

Search AIMS

Find pages, publications, events, course projects, and software. Results update as you type; press Enter to open the first result.

Science

REVOLVE

REVOLVE solution-optimization evaluation: Llama-3.1-8B-Instruct performs test-time training on GPQA-Diamond (198 items) and MMLU Machine Learning (112 items) multiple-choice questions, optimized either by the TextGrad baseline (v1) or by REVOLVE (v2, response-evolution tracking). Binary exact-match correctness of the extracted answer letter at each optimization stage (initial zero-shot, iterations 1-3, majority-vote final).

310items
2subjects
MITlicense
sciencedomain
knowledgedomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No

Response matrix

Loading response matrix…

Correct (1)Incorrect (0)Unobserved

Scale: 1 = correct · 0 = incorrect