Reward Modeling
RewardBench
RewardBench tests whether reward models prefer the better of two candidate responses to a prompt, over prompts covering chat, safety and reasoning.
2,733items
118subjects
ODC-BYlicense
reward_modelingdomain
textmodality
item-level responses released
Saturation status: Yes
Response matrix
Loading session strips…
lowhighUnobserved
Scale: {0, 0.5, 1} (0.5 = judge tie, <1% of rows)