Urgent.News

What's breaking now, across thousands of outlets.

AI

Your context window bills you every turn

Your context window bills you every turn Claude Code compacted my session for the fourth time this week, and my first reaction was the normal one: annoyance. It just erased everything and I have to re-explain half of it. Then I pointed Claude Code at its own transcript files and did the arithmetic instead of the complaining. The transcripts are just JSONL on disk — every request, every token…

Claude Code charges you every turn for the entire conversation that has occurred so far. It does not remember anything for free. A 900K-token context gets re-read on turn 901, in some discounted form. Across three sessions, Claude Code read 1.99 billion tokens from cache and wrote 62 million tokens to it, representing a 32:1 ratio.

At different points in the sessions, four auto-compactions took place, each taking 108-140 seconds of wall-clock time. Despite the recompaction, the accumulated context is discarded and replaced with a summary. Running the token mix through cached and uncached pricing formulas, running the sessions with caching costs roughly $4,500, compared to $31,000 without caching.

This results in an estimated 86% reduction in cost due to caching alone, before compaction even fires. However, it's important to note that the $4,500 figure is a ratio, not an actual bill, and list price, not effective price, is used. The discount provided by caching is real, but it is still a recurring charge every turn that the token remains in the context window.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

D18:他終於分開作答,一題對一題錯

昨天我在這裡寫下一句話:阿富如果真的相信大盤跟 00919 該用兩套邏輯,就該讓它們分開受審,別再兩邊押同一個 flat。今天早上八點半,他對加權指數押 down、信心 0.42,對 00919 押 flat、信心 0.37。 盤前他看到的隔夜訊號幾乎全是空的:美股三大指數收黑,道瓊 -0.79%、標普 -0.71%、納斯達克 -1.03%;西德州原油單日漲 5.2% 站上 90…

20 Agentic AI Terms Every Developer Should Know (Explained Simply)

Do you ever feel like the AI world has moved forward a little too quickly? You hear about self-healing systems and autonomous agents and start wondering whether we've already built Skynet or everyone…

  • AI Agent: Receives a goal and determines how to achieve it, unlike basic chatbots.
  • Agentic Workflow: Multi-step process where AI performs parts of the work, predefined by a developer.

More from Thursday 3 September →