Medical
AfriMed-QA: medical QA for African healthcare contexts; binary correctness on MCQ items.
Response matrix
Each row is an AI model and each column an item, ordered so the strongest models and easiest items gather toward one corner. 30 subjects × 6,910 items, 54% of cells evaluated. The heatmap shows a representative 90 of 6,910 items — evenly sampled across difficulty — so each cell stays square and legible.
Scale: 1 = correct · 0 = incorrect
Sample items
A spread of items across the difficulty range, each shown with a few subjects' actual answers.
An 80-year-old man is referred from a nursing home with fever, rigors, nausea and vomiting. He is bedridden and has sacral decubitus ulcers. Blood cultures grow streptococcus milleri. The most likely site of infection is? A) Sacral bedsores B) Urinary tract infection C) osteomyelitis D) liver abscess E) Endocarditis
How subjects answered
A
A
E
Theoretically, what kind of injury related to laparoscopic entry should be reduced by the Hasson (open) technique, compared to a Veress needle entry? A. Bladder injury B. Bowel injury C. Major vessel injury D. Splenic injury E. Ureteric injury
How subjects answered
B
B
C
Typhoid fever A. can be caused by any of the Salmonella species B. low infective dose of organism is required C. carriage is associated with gall bladder disease D. main stay of diagnosis is Widal test E. chloramphenicol is the main drug of choice
How subjects answered
C
C
B
A 54 year old male patient has a history of cough productive of green sputum with shortness of breath and left pleuritic chest pain. His temperature is 38.4 C, respiratory rate 22 bpm, pulse 110bpm, WBC 12.4 x 109 /L and his CXR shows consolidation at the left base. What is the most likely causative organism for this presentation? A) Haemophilus influenzae B) Klebsiella pneumonia C) Mycoplasma pneumoniae D) Staphylococcus aureus E) Streptococcus pneumoniae
How subjects answered
E
E
E
Which respiratory condition is characterized by recurring episodes of wheezing, shortness of breath, and chest tightness? A) Chronic obstructive pulmonary disease (COPD) B) Asthma C) Pneumonia D) Tuberculosis E) Emphysema
How subjects answered
B
B
B
A 46-year-old woman with a history of relapsing and remitting multiple sclerosis comes to the clinic for review. She has been stable for the past 6 months and is currently treated with oral fingolimod. Neurological examination reveals poor coordination, more marked on the left than the right, although there are no other significant signs. Which of the following correctly represents the mode of action of fingolimod? A. B-cell cytotoxic B. Mimics myelin peptides C. Prevents lymphocyte movement across the blood–brain barrier D. T-cell cytotoxic E. Increases the expression and concentration of anti-inflammatory agent
How subjects answered
C
C
C
Subjects
30 subjects, ranked by mean response (accuracy) across this benchmark's items.