Neural Expansion: A Unified Mechanism for How Deep Neural Networks Generalize
Deep neural networks demonstrate remarkable generalization despite being highly over-parameterized, challenging traditional statistical learning theories. While several theoretical paradigms such as margin-based bounds, PAC-Bayesian analyses, and neural tangent kernels provide global explanations, they often lack mechanistic insight into how generalization emerges from training dynamics. We…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
