ASLEval: Measuring Privacy Exposure Displacement in LLM Agent Sessions
Privacy evaluations of tool-using LLM agents often inspect a designated action, final response, or attacker report. These local proxies can miss unauthorized exposure elsewhere in a multi-step session and lack common ground truth across outlets, reports, and tool paths. We introduce privacy exposure displacement, the mismatch between a local evaluation proxy and target-grounded session exposure,…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
