Model Compression Beyond Quantization
Overview This post is divided into three parts; they are: • Pruning and Sparsity • Structured Pruning • Knowledge Distillation Pruning and Sparsity Pruning sets selected model parameters to zero or removes larger structures.
We haven't written up this one. Machine Learning Mastery has the full story — the link below goes straight to it.