Annotrace: A Workbench for Step-Level Annotation of Agent Traces
Every study of why LLM agents fail begins by labelling traces by hand, and every such study builds its own throwaway tool. Observability platforms record agent traces but offer no structured labelling; annotation tools label text but have no notion of a step, a delegation or a tool call, leaving it unclear what the smallest unit of execution to label should be. Annotrace reads six trace formats,…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
