LACE: Layer-Wise Compression for Dynamic Frame Rate Codecs
Neural audio codecs are a key component in speech language modeling. However, their high frame rates lead to long sequence lengths, increasing computational costs. Dynamic frame rate codecs mitigate this by reducing the effective frame rate using a compression step to merge multiple frames together. However, most prior methods either operate on single-codebook codecs or apply a single compression…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
