Urgent.News

What's breaking now, across thousands of outlets.

AI

Looped reasoning means the AI's visible trace isn't the reasoning

GPT-6 Astra ships looped transformers: the same blocks run ~44 passes, reusing weights, so effective depth doubles without new parameters. The KV cache and the intermediate states differ per pass, but the tokens you actually see are only one layer of that surface. Here's the part that matters for anyone evaluating agents or reviewing AI-generated code: when the reasoning is hidden inside those…

GPT-6 Astra introduces looped transformers: the same blocks execute approximately 44 times, reusing weights, thereby doubling the effective depth without requiring additional parameters. The key points, relevant for anyone reviewing AI-generated content or assessing agents, are as follows: the reasoning becomes concealed within those loops, whereas the transcript generated by the model is essentially a summary penned after the fact.

The text is genuine, but it functions more as narration, providing a plausible account of the model's journey from input to output. The actual computation unfolds through multiple recurrent passes that remain inaccessible for inspection. This subtle shift fundamentally alters established review and benchmark frameworks.

Traditionally, chain-of-thought reasoning serves as compelling evidence, enabling reviewers to gauge the model's consideration of edge cases, its recognition of modifications to shared enums, and adherence to repository style guidelines. However, when the trace is decoupled from the computation, judging the trace essentially becomes an evaluation of the model's narrative, rather than its true thought process.

This separation does not imply dishonesty on the model's part, but it does introduce a challenge in discerning when the narration aligns with the computation and when it diverges. Such divergence may conceal subtle bugs or lead to misguided reviews.

For effective evaluation design, it is prudent to abandon the notion that the visible reasoning represents the ground truth. Instead, focus on instrumenting elements that can be directly verified: the tool loop, the files manipulated by the agent, the final diff, and the observable behavior. These aspects are tangible and verifiable.

The chain of thought emerging from a looped model should be perceived as a report rather than a recording. It is essential to recognize that models designed for transparency and those with hidden traces are fundamentally distinct systems. Consequently, a number derived from a transparent variant may not reliably apply to the default shipping model.

This distinction represents a foundational harness difference before even considering the quality of reasoning. Therefore, it is imperative to clearly specify which system the measured number pertains to.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

More from Friday 11 September →