PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
As Large Language Models (LLMs) evolve into autonomous agents that alter real-world states, ensuring operational safety across multi-step workflows has become a critical challenge. While recent work has moved beyond single-turn evaluation toward multi-turn paradigms, key limitations persist: step-level methods treat actions in isolation, missing how risks accumulate, while trajectory-level…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.