Preference
Preference Dissection
Preference Dissection records which of two candidate replies to the same prompt each model judge prefers, turning the judges themselves into the systems being measured.
5,239items
32subjects
CC-BY-NC-4.0; retain attribution, upstream model-output terms and prohibition on re-identification; see raw/README.md.license
preferencedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Subjects are the ~32 AI judges; human annotations are filtered out.
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect