ServerBench: How can your coding agents design specialized LLM serving systems?
Large language model (LLM) coding agents develop software through experimentation, offering an opportunity to design the serving systems supporting their own operation. Effective serving requires coordinating implementation and operating decisions under session dependencies, latency constraints, and correctness requirements. We introduce ServerBench, a benchmark for agentic design of complete,…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
