Evolving Semantic Indexes for Generative Retrieval
Generative retrieval (GR) casts search and recommendation as autoregressive generation of discrete semantic identifiers (SIDs). SID design largely determines GR quality, but its discrete, interdependent components (SID construction, collision handling, decoding, and training) cannot be optimized end-to-end with gradients and remain largely hand-designed. We introduce a framework that improves…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.