Urgent.News

What's breaking now, across thousands of outlets.

More in AI

Are we software engineers doomed? Yes, because of AI!

Companies have stopped hiring, and layoffs have become more and more common. Job postings are rarely found. New types of roles are appearing and disappearing so fast that it is now nearly impossible…

  • Companies resort to layoffs amid AI advancements, impacting software engineers.
  • Cutting-edge AI tools like Claude Fable 5 and GPT 6 Astra revolutionize task handling.
  • Software engineers contemplate career pivots, but risk of AI automation remains.

Write the reference before debugging the shader

The Flash Attention 2 path was easier to finish after the algorithm existed in plain JavaScript first. The forward pass used one workgroup per batch, head, and query tile.

  • Flash Attention 2 initially coded in JavaScript
  • Backward pass recomputed attention using q, k, log-sum-exp
  • Shader code derived from mathematical concepts, not initial implementation

More from Tuesday 15 September →