Where Do LLM Ensemble Gains Come From? Decomposing Candidate Value, Diversity, and Aggregation
LLM ensemble gains are often measured against a single baseline, but the value attributed to additional candidates can change with the comparison used. We study an LLM aggregator under four matched conditions: Direct (no candidates), Single-slot (one candidate in a multi-slot interface), Duplicate (one candidate repeated), and Multi-candidate (separately generated candidates). Under either…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.