Google Open-Sources TPU Sync for KV Cache and Weight Transfer on TPUs
Google Cloud has open-sourced TPU Sync, a native C++ library that moves KV cache blocks and model weights between TPU HBM, host DRAM, shared storage, and the data center network. By Daniel Dominguez
We haven't written up this one. InfoQ has the full story — the link below goes straight to it.