ExecCritic: Learn to Test, Test to Improve for Coding Agents
Execution feedback can guide coding agents toward correct repository repairs, but only when the tests capture the behavior requested by the issue. Agent-generated tests can encode incomplete or incorrect behavioral targets; when the same trajectory writes both the patch and the test, their errors can agree and create false confidence. We introduce ExecCritic, combining a test--verify--revise…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
