D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding
Target-conditioned diffusion drafters predict candidate tokens in parallel, yet each new block must wait for updated target-model hidden states. This forces drafting and verification to run sequentially, limiting speedup even though each block is generated in one pass. We introduce D3D, a standalone diffusion drafter that removes this inter-round dependency. D3D combines blockwise denoising with…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
