Science & Engineering
CROP benchmark: 5,045 bilingual (Chinese/English) crop-science multiple-choice questions across three difficulty levels, derived from 2K+ crop-science academic papers. Each item asks the model to select the correct option; the response is whether the chosen option was correct. We ingest the authors' released per-(model, item) grading matrix for four commercial LLMs.
Response matrix
Each row is an AI model and each column an item, ordered so the strongest models and easiest items gather toward one corner. 4 subjects × 5,045 items, 100% of cells evaluated.
Fit to width. Hover for subject & item; click a cell for details.
Scale: 1 = correct · 0 = incorrect
Sample items
A spread of items across the difficulty range. This benchmark does not publish per-answer traces, so each item shows which subjects succeeded.
CROP crop-science multiple-choice question (benchmark ID 5093; difficulty: difficult). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 3718; difficulty: difficult). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 2512; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 1363; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 2904; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 1932; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 1209; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 4891; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 4889; difficulty: moderate). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 1426; difficulty: easy). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 4957; difficulty: easy). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
CROP crop-science multiple-choice question (benchmark ID 4775; difficulty: easy). The model must select the single correct option (A-D); scored 1 if correct.
Subject outcomes
Subjects
4 subjects, ranked by mean response (accuracy) across this benchmark's items.