Passing Once Isn't Reliable — This Week's Agent Engineering Puts the Harness Before the Model

This week's AI agent developments focus on orchestration patterns, tool/function calling, memory, planning loops, multi-agent coordination, and agent evaluation. AgentWeave, a new system, filters tool sets before prompts are processed, reducing tool exposure by 70%, input tokens by 62%, and latency by 51%. However, pass@1 success rates in Thinkingbox, a sandbox and benchmark, do not guarantee reliability as seen in the drop from 65.36% pass@1 to 25.25% pass@20.

Spine-Branch Coordination for Multi-agent Computer Use tackles VM state merging in multi-agent systems, lifting success rate by 6-16.5 points and cutting cost per task by 34-70%. AutoSaddler optimizes the agent's external harness using execution traces, resulting in gains of 9-10 points across three benchmarks. LangSmith Tuned Evaluators, starting with Perceived Error, grade 100% of production traffic, cutting evaluation cost by 82% while maintaining quality.

Anthropic Engineering Blog and LangChain / LangGraph Blog introduced new tools and frameworks for testing and evaluating agents, emphasizing the importance of the agent harness and its impact on performance.