Preference
Prompt-to-Leaderboard
Prompt-to-Leaderboard ranks models on individual prompts using head to head battles in which a person sees two models' answers to the same prompt and votes for one or calls it a tie.
128,287items
53subjects
CC-BY-4.0license
preferencedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Rows are model pairs, ordered by how many items the pair was compared on; within a row the comparisons are sorted by outcome. A column position is not a shared item — arena prompts are almost never reused across pairs, so cells in the same column are different items.
Loading session strips…
lowhighUnobserved
Scale: {0, 0.5, 1} (loss / tie / win, human pairwise vote)