ICON Decomposition: Multivariate Concept-Level Explanations of Deep Representations for Model Auditing
Deep neural networks often exploit spurious associations in their training data, a failure known as shortcut learning. Concept-based explainability methods screen for shortcuts by testing whether concepts such as a patient's sex or scanner settings can be decoded from a network layer. Because each concept is evaluated in isolation, these methods can mistake correlations between concepts as…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
