Prune Gradually, Adapt Sparsely: Efficient Pruning of Large Language Models at Extreme Sparsity
Weight pruning can reduce the storage and inference cost of large language models (LLMs), but preserving quality at high sparsity levels remains challenging. Existing methods face a quality-cost trade-off in this regime. One-shot pruning is cheap but degrades sharply as sparsity increases, even when followed by post-pruning recovery. A growing line of work instead optimizes the mask directly from…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
This story
This is one outlet's version. Read the fullest account.
