Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World Systems
Answer accuracy is an insufficient reliability signal for LLM data agents. In structured-data tasks, a benchmark-correct answer can be produced by an invalid trace. This paper introduces Trace Integrity, a deployment reliability criterion for evaluating whether the computation recorded behind an answer is explicit, executable, schema-valid, operator-faithful, replayable, answer-consistent, and…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
