Hidden not Deleted: How Networks Suppress Entangled Features
Concept erasure methods that operate via linear projection assume that features occupy separable subspaces. We show this assumption fails under dense superposition: when two features are forced into an antipodal pair sharing a single subspace, state-of-the-art linear erasure destroys both, not just the target. Networks trained with gradient descent instead solve this problem non-linearly, but not…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
