Agents & Tool Use

tau2-bench

Recorded customer-service agent trials in the airline, retail and telecom domains, including the original telecom ablations.

2,385items

31subjects

MITlicense

agents_and_tool_usedomain

textmodality

item-level responses released

Saturation status: Yes

Full data on Hugging Face Back to the gallery

Paper and credit

2025

τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment (opens in a new tab)

Original source

Authors

Victor Barres, Honghua Dong, Soham Ray, Xujie Si +1 moreShow all

01Victor Barres
02Honghua Dong
03Soham Ray
04Xujie Si
05Karthik Narasimhan

Citation

BibTeX citationShow

BibTeX

1@misc{barres2025tau2benchevaluatingconversational,
2      title={$\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment},
3      author={Victor Barres and Honghua Dong and Soham Ray and Xujie Si and Karthik Narasimhan},
4      year={2025},
5      eprint={2506.07982},
6      archivePrefix={arXiv},
7      primaryClass={cs.AI},
8      url={https://arxiv.org/abs/2506.07982},
9}

Response matrix

Loading response matrix…

Correct (1)Incorrect (0)Unobserved

Scale: 1 = correct · 0 = incorrect