Untangling the Mechanisms of Misleading Context in Medical Question Answering
Large language models now answer medical questions with expert-level performance. However, the context these systems act on can be misleading, and misleading context can corrupt a model's medical judgment. To understand how misleading context corrupts this judgment, we examine the model's susceptibility to the context, disclosure of it, mechanism of corrupted reasoning, and monitorability of the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
