One Loop, Two Gains: Can Active Learning win the Lottery for Free?
The lottery ticket hypothesis posits the existence of winning tickets: sparse subnetworks that, when trained in isolation from their original initialization, match the accuracy of the full dense network. The predominant method for discovering such tickets, iterative magnitude pruning, alternates pruning with full retraining from scratch until convergence over many cycles. Similarly, deep active…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
