Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,842 articles
SRE & Ops — Disaggregated Scheduled Fabric: Scaling Meta’s AI Journey

Disaggregated Scheduled Fabric: Scaling Meta’s AI Journey

Disaggregated Schedule Fabric (DSF) is Meta’s next-generation network fabric technology for AI training networks that addresses the challenges of existing Clos-based networks. We’re sharing the challenges and innovations surrounding DSF and discussing future directions, including the creation of mega clusters through DSF and non-DSF region interconnectivity, as well as the exploration of alternati

CWChris Wiltz·October 20, 2025SRE & Ops
AI & ML — Scaling LLM Inference: Innovations in Tensor Parallelism, Context Parallelism, and Expert Parallelism

Scaling LLM Inference: Innovations in Tensor Parallelism, Context Parallelism, and Expert Parallelism

At Meta, we are constantly pushing the boundaries of LLM inference systems to power applications such as the Meta AI App. We’re sharing how we developed and implemented advanced parallelism techniques to optimize key performance metrics related to resource efficiency, throughput, and latency. The rapid evolution of large language models (LLMs) has ushered in a […]

PHPhil Hornshaw·October 17, 2025AI & ML
AI & ML — AI In UX: Achieve More With Less — Smashing Magazine

AI In UX: Achieve More With Less — Smashing Magazine

A simple but powerful mental model for working with AI: treat it like an enthusiastic intern with no real-world experience. Paul Boag shares lessons learned from real client projects across user research, design, development, and content creation.

PBPaul BoagPaul Boag·October 17, 2025AI & ML
SRE & Ops — Branching in a Sapling Monorepo

Branching in a Sapling Monorepo

Sapling is a scalable, user-friendly, and open-source source control system that powers Meta’s monorepo. As discussed at the GitMerge 2024 conference session on branching, designing and implementing branching workflows for large monorepos is a challenging problem with multiple tradeoffs between scalability and the developer experience. After the conference, we designed, implemented, and open sourc

CWChris Wiltz·October 16, 2025SRE & Ops
SRE & Ops — 10X Backbone: How Meta Is Scaling Backbone Connectivity for AI

10X Backbone: How Meta Is Scaling Backbone Connectivity for AI

We’re sharing details on our journey to scale Meta’s Backbone network to support the increasing demands of new and existing AI workloads. We’ve developed new technologies and designs to address our 10x scaling needs and applying some of these same principles to help extend our AI clusters between multiple data centers. Meta’s Backbone network is […]

PHPhil Hornshaw·October 16, 2025SRE & Ops
Performance — Unpacking Cloudflare Workers CPU Performance Benchmarks

Unpacking Cloudflare Workers CPU Performance Benchmarks

Cloudflare investigated CPU performance benchmark results for Workers, uncovering and fixing issues in infrastructure, V8 garbage collection, and OpenNext optimizations. These improvements have made Cloudflare Workers faster for all customers.

KVKenton VardaKenton Varda·October 14, 2025Performance
SRE & Ops — Design for Sustainability: New Design Principles for Reducing IT Hardware Emissions

Design for Sustainability: New Design Principles for Reducing IT Hardware Emissions

We’re presenting Design for Sustainability, a set of technical design principles for new designs of IT hardware to reduce emissions and cost through reuse, extending useful life, and optimizing design. At Meta, we’ve been able to significantly reduce the carbon footprint of our data centers by integrating several design strategies such as modularity, reuse, retrofitting, […]

CWChris Wiltz·October 14, 2025SRE & Ops
Engineering — Introducing stablecoin payments for subscriptions

Introducing stablecoin payments for subscriptions

As businesses expand globally, stablecoins can help them reach a broader international audience more cost-effectively. Now we’re extending these benefits to subscription-based businesses by launching recurring payments with stablecoins.

JLJennifer LeeJennifer Lee·October 14, 2025Engineering