Search Subscribe
Home/SRE & Ops/HubSpot Migrating ZooKeeper into Kubernetes - High Scalability -
SRE & Ops

HubSpot Migrating ZooKeeper into Kubernetes - High Scalability -

We recently migrated hundreds of ZooKeeper instances from individual server instances to Kubernetes without downtime. Our approach used powerful Kubernetes features like endpoints to ease the process, so we’re sharing the high level outline of the approach for anyone who wants to follow in our footsteps. See the end for important networking prerequisites. Click to read more

FM
Francesca McCaffreyHigh Scalability
·April 14, 2020
HubSpot Migrating ZooKeeper into Kubernetes - High Scalability -

We recently migrated hundreds of ZooKeeper instances from individual server instances to Kubernetes without downtime. Our approach used powerful Kubernetes features like endpoints to ease the process, so we’re sharing the high level outline of the approach for anyone who wants to follow in our footsteps. See the end for important networking prerequisites. Click to read more

FM
Written by
Francesca McCaffrey
High Scalability

Writes for High Scalability. Part of the Tech Report engineering index.

All articles by Francesca McCaffrey →
Keep reading

Related Articles

SRE & Ops — ZGateway: Learnings from Putting a Proxy in Front of ZippyDB

ZGateway: Learnings from Putting a Proxy in Front of ZippyDB

We’re introducing ZGateway, the proxy we are using to unify traffic through ZippyDB, Meta’s most widely-used key value store. As a bonus, it also enables admission control, load balancing, cross-region resilience, and richer operations. ZippyDB is the most widely used key value store at Meta, backing product metadata, counters, and configuration, and can serve billions […]

CWChris Wiltz·September 3, 2026SRE & Ops
SRE & Ops — MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet

MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet

Training and serving frontier AI models depends on fast, reliable networks that move data between GPUs without wasting compute cycles. To meet this challenge at scale, Meta designed MetaRoCE – a clean-sheet RDMA transport protocol purpose-built for AI workloads on commodity Ethernet. We’re releasing the MetaRoCE specification, a reference software implementation and a compliance test […]

CWChris Wiltz·August 24, 2026SRE & Ops
SRE & Ops — MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

MTIA 300 is the first of Meta’s family of in-house training and inference accelerators optimized for training ranking and recommendation models. We’re sharing how MTIA 300’s built-in NIC chiplets allow it to meet the communication needs associated with training recommendation models with superior performance over general-purpose GPUs. By co-designing MTIA’s communication library, HCCL, alongside t

CWChris Wiltz·August 24, 2026SRE & Ops