Rethinking Circuit Evaluation: Do Circuits Explain Model Errors?
Mechanistic interpretability (MI) aims to explain a model's behaviour through analyzing its internal computations; circuit-based explanations aim to isolate these computations with compact subnetworks validated by ablating the rest of the model. We show that circuits validated this way may fail to recover the underlying mechanism of the model's behaviour by closely reproducing its successful…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.