Raptor: Rejection-aware Adaptive Tree based on Speculative Decoding
Tree-structured speculative decoding accelerates vision-language models (VLMs) by verifying multiple candidate continuations in parallel. However, long visual contexts increase the cost of speculative computation, making candidate coverage and redundant expansion important considerations beyond tree topology adaptation. We propose Raptor, a training-free framework that uses rejection feedback to…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.