When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue
Understanding spoken dialogue requires joint reasoning over lexical content and paralinguistic acoustic signals such as emotion and conversational intent. However, existing evaluations often allow shortcuts based on transcripts or single-modality solutions, obscuring whether models genuinely ground predictions in speech. We formalize this failure mode as cross-modal disagreement, where…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
