MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant
Conversational voice agents have advanced significantly, offering increasingly natural human-machine interactions through both cascaded and end-to-end architectures. However, while recent benchmarks extensively evaluate dyadic interactions and passive audio comprehension, they largely overlook a prevalent real-world scenario: multi-party conversations. Evaluating agents in these settings is…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
