A Scary Implication of OpenAI’s Math Breakthroughs
Maybe the big AI companies will get out of the token-selling business.
We haven't written up this one. Bloomberg has the full story — the link below goes straight to it.
More in AI
An LLM observability platform stores prompts, and prompts are the application
An LLM observability platform stores prompts, and prompts are the application A title query for Langfuse returns 346 matches in ZoomEye. The number is small and the contents are unusual.
- LLM observability platform records prompts as application logic
- Traces contain prompts, model parameters, completion details
- Langfuse indexes sensitive traces, including potential secrets
Tests are the only fixed point left when the implementation is disposable
Originally published at https://aicoding-guide.com . The more disposable the implementation becomes, the more the spec moves into the tests. That is the claim.
- Tests serve as the fixed point in disposable implementations.
- Tests guide correctness when code is rewritten repeatedly.
- Certain domains require alternative fixed points beyond tests.
How AI is being used to both attack and defend against hackers in 2026 — according to a new WEF report
AI now works for hackers and defenders at once. A new report tracks deepfake scams, autonomous attacks, and faster detection.
Your LLM Types One Token at a Time. It Doesn't Have To.
Every token your LLM emits costs one full forward pass through the entire model. Seventy billion parameters loaded from memory, multiplied, discarded — for a single token. Then again. And again.
- Speculative decoding drafts tokens with cheap model before big model verification
- Acceptance rule accepts drafted token with probability min(1, q(d)/p(d))
- EAGLE-3 achieves 2-3x speedup over vanilla decoding, but diminishing returns at high batch sizes
The agent finished. Who turns off the VM?
Suppose a coding agent opens a pull request at 6 p.m. The tests pass, a preview is running, and the reviewer has already logged off. The agent's task is complete.
- Agent session ends when task result is saved
- Preview retained only until explicit expiry time
- Workspace removal depends on commit status
She Designed Meta’s New AI Logo. Then Came the Hate
Jessica Hische knew working for Meta might upset some people. But she didn’t anticipate just how angry they would get.