Medicine

SMMILE

SMMILE: an expert-driven benchmark for multimodal medical in-context learning. 111 problems (517 image-question-answer triplets) across 6 specialties and 13 imaging modalities; multimodal LLMs evaluated zero-shot vs with in-context examples on closed-ended MCQA and open-ended (exact-match / LLM-as-a-judge) accuracy. SMMILE++ permutes the in-context demonstrations into 1038 problems.