Medicine
MedHELM EHRSQL
MedHELM ehr_sql: per-(model, item) ehr_sql_execution_accuracy in {0,1} (1=correct) on 1000 translating a natural-language clinical question into SQL over an EHR database. 13 models from the MedHELM v4.0.0 release.
1,000items
13subjects
unknownlicense
medicinedomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
Correct (1)Incorrect (0)Unobserved
Scale: 1 = correct · 0 = incorrect