AuDiR: Diagnosing Audio Reasoning with Rule and Percept Interventions
Answer accuracy alone does not distinguish failures in acoustic perception, rule knowledge, and rule application. AuDiR (Audio Diagnostic Reasoning) examines these distinctions through controlled input interventions. Each item contains an audio clip, a multiple-choice question, a task-general rule, and a textual description of the acoustic observations needed to answer. Three conditions…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
