VPRune: Efficient Training-free Pre-LLM Visual Token Pruning
Visual token pruning is a promising approach to reducing the inference cost of large vision-language models (LVLMs), yet aggressive token reduction often causes substantial performance degradation. We identify three key factors behind this degradation: text-guided selection bias, information loss from discarded tokens, and positional distortion caused by sequence compaction. Based on these…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
