Reasoning

BABILong

BABILong: long-context reasoning-in-a-haystack. bAbI reasoning questions (qa1..qa20) are embedded in distractor contexts of varying token length (0k..10M); a model passes an item iff its answer matches the gold bAbI label. Per-item model outputs are released for qa1..qa5 for two models; scored {0,1} by BABILong's string-label metric.