Acoustic-to-Text KV Compression for Full-Duplex Speech Models
Full-duplex speech language models continuously accumulate acoustic key-value (KV) states, making long-running interactions memory-intensive. During listening, the model can finish processing an audio unit before the next arrives; we term the remaining interval listening-time slack. We propose acoustic-to-text KV compression, which introduces a transcription side channel to convert incoming…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.