Science
REVOLVE
REVOLVE solution-optimization evaluation: Llama-3.1-8B-Instruct performs test-time training on GPQA-Diamond (198 items) and MMLU Machine Learning (112 items) multiple-choice questions, optimized either by the TextGrad baseline (v1) or by REVOLVE (v2, response-evolution tracking). Binary exact-match correctness of the extracted answer letter at each optimization stage (initial zero-shot, iterations 1-3, majority-vote final).
310items
2subjects
100%observed
MITlicense
sciencedomain
knowledgedomain
reasoningdomain
textmodality
Response matrix
Fit to width. Hover for subject & item; click a cell for details.

Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect
Subjects
- 1Llama-3.1-8B-Instruct+REVOLVE0.3568
- 2Llama-3.1-8B-Instruct+TextGrad0.3277