Yelp Migrates Cassandra to EKS by Moving EBS Volumes
Yelp has moved its Cassandra fleet from legacy self-managed Kubernetes clusters to Amazon EKS by re-pointing existing EBS volumes at new pods, rather than streaming data between nodes. By Claudio Masolo
Yelp successfully transferred its Cassandra database clusters from self-managed Kubernetes to Amazon EKS without any downtime or data loss. The company's engineering team developed a custom process called "Rolling PV Transplant" to accomplish this, which involved reassigning existing EBS volumes to new pods in the EKS cluster. This method eliminated the need for data streaming between nodes and reduced downtime to zero.
The largest cluster, consisting of 54 pods, took approximately 12 hours to complete the migration. Yelp's approach is unique in that it leverages the fact that EBS volumes are associated with Availability Zones rather than Kubernetes clusters, allowing for seamless detachment and attachment of volumes to new pods. The process was automated using a bash script generated by Claude, based on a validated manual runbook, and took about three weeks to implement across multiple clusters.
Yelp emphasized the importance of thorough backup and monitoring procedures, as well as monitoring for potential issues like stale VolumeAttachment objects that can arise during the migration process.
Written by urgent.news from InfoQ's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.