Right Diagnoses, Decorative Reasoning:A Perturbation Audit of Medical Chain-of-Thought
Clinicians read chain-of-thought (CoT) rationales as evidence of medical reasoning, but whether the visible chain plays that role is rarely tested. General-domain CoT-faithfulness probes ignore clinical cost, and medical LLM evaluations treat the chain as a black box. We close this gap with a medical perturbation audit: a 30-operator battery edits both the chain and the question with clinically…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
