Urgent.News

What's breaking now, across thousands of outlets.

More in Tech

Gemma 4 in Pure JAX: What Changes Between Turing and Ada, and What Doesn't

This article is a measurement report on running a hand-written Gemma 4 port in pure JAX across two NVIDIA GPUs a generation apart, and on the two places the "it's just JAX" abstraction leaks.

  • Gemma 4 port runs in pure JAX on Turing and Ada GPUs
  • Compute dtype policy sets bfloat16 on both GPUs, causing performance hit on Turing
  • KV ring cache bug due to irregular Gemma 4 geometry prevents optimal port performance

More from Monday 31 August →