Knowledge

ERBench

ERBench: an Entity-Relationship based, automatically verifiable hallucination benchmark. Yes/no questions are generated from relational databases (functional dependencies and foreign keys) across five domains (movie, book, music, soccer/olympic, airport); each question has a deterministic gold answer and a model passes iff its answer matches it.