Label-Guided Knowledge Distillation for 3D-CNNs in Action Recognition
As a key model compression technique, knowledge distillation aims to transfer knowledge from a high-capacity teacher model to a lightweight student model for enhancing the latter's performance. In this work, we reviewed the feature knowledge distillation for 3D-CNNs and observed that most feature distillation methods in video analysis are simple adaptations of those used in image analysis, often…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
