CliffCompaction: Cost-Efficient Compaction for Long-Horizon Coding Agents
Agents often work on complex problems that require millions of tokens of context, which necessitates compacting across sessions due to limited context windows. We develop CliffCompaction, an autocompaction technique that reduces cost by up to 50% under a bounded context while maintaining or improving performance on Terminal-Bench and achieving new levels of efficiency for test-time scaling and…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.