Gacha Decoding: Eliciting Diverse Generations Through Instruction Following
We introduce Gacha Decoding, an inference-time method for eliciting diverse language model generations that scales with model capability. Across open-ended domains (in-the-wild chat, creative writing, planning for image generation, and protein design), Gacha Decoding significantly outperforms existing generation diversity approaches at equal quality (up to 2.4x Vendi over the next-best prior…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
