Skip to main content

Science

REVOLVE

REVOLVE solution-optimization evaluation: Llama-3.1-8B-Instruct performs test-time training on GPQA-Diamond (198 items) and MMLU Machine Learning (112 items) multiple-choice questions, optimized either by the TextGrad baseline (v1) or by REVOLVE (v2, response-evolution tracking). Binary exact-match correctness of the extracted answer letter at each optimization stage (initial zero-shot, iterations 1-3, majority-vote final).

310items
2subjects
100%observed
MITlicense
sciencedomain
knowledgedomain
reasoningdomain
textmodality

Response matrix

Fit to width. Hover for subject & item; click a cell for details.

REVOLVE response matrix: AI models (rows) against items (columns)
Correct (1)Incorrect (0)Unobserved

Scale: 1 = correct · 0 = incorrect

Subjects

  1. 1Llama-3.1-8B-Instruct+REVOLVE0.3568
  2. 2Llama-3.1-8B-Instruct+TextGrad0.3277