Meta’s ZGateway Cuts ZippyDB Connections 19x While Handling 1B+ Operations per Second
Meta has introduced ZGateway, a stateless proxy for ZippyDB that centralizes connection management, traffic routing, caching, load balancing, and admission control. The gateway handles more than 1 billion operations per second and about 40% of ZippyDB traffic, while Meta’s model estimates a 19x reduction in persistent connections. By Leela Kumili
Meta has introduced ZGateway, a stateless proxy layer for its ZippyDB distributed key-value store, to address connection and reliability challenges associated with over one million client hosts. The gateway handles over 1 billion operations per second and reduces total persistent connections by around 19x. By placing a managed proxy tier between clients and ZippyDB servers, ZGateway maintains sticky connections to regional gateway hosts, while database servers receive connections from the controlled gateway fleet.
This architecture not only helps prevent file descriptor exhaustion and out-of-memory conditions but also shifts where shared traffic management occurs, enabling Meta to authenticate and authorize requests, apply per-tenant admission control, resolve shards, use local caching, and batch or coalesce requests before forwarding them to ZServer replicas.
Brief written by urgent.news from InfoQ's own syndicated text. Machine-written — may contain errors; check the original before relying on it.
