The Sirens' Song: When Proximal Background Context Overshadows Distant Evidence
Long-context LLMs focus on retrieving distant evidence from extensive context, yet existing work has largely focused on overcoming distance alone. In this work, we identify the Proximity Trap, insufficient attention to distant evidence often arises less from distance itself than from cumulative competition with abundant, task-irrelevant proximal background. To address the Proximity Trap, we…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
