Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,851 articles
SRE & Ops — Open-sourcing TAOBench: An end-to-end social network benchmark

Open-sourcing TAOBench: An end-to-end social network benchmark

What the research is: The continued emergence of large social network applications has introduced a scale of data and query volume that challenges the limits of existing data stores. However, few benchmarks accurately simulate these request patterns, leaving researchers in short supply of tools to evaluate and improve upon these systems. To address this issue, […]

CWChris Wiltz·September 7, 2022SRE & Ops
Networking — Network Entitlement: A contract-based network sharing solution

Network Entitlement: A contract-based network sharing solution

Meta’s overall network usage and traffic volume has increased as we’ve continued to add new services. Due to the scarcity of fiber resources, we’re developing an explicit resource reservation framework to effectively plan, manage, and operate the shared consumption of network bandwidth, which will help us keep up with demand and limit network disruptions during […]

CWChris Wiltz·September 7, 2022Networking
Systems — Four Approaches to Debugging Server-side WebAssembly - Shopify

Four Approaches to Debugging Server-side WebAssembly - Shopify

While it has many benefits for customizing business logic, WebAssembly poses new challenges when debugging. In this post, Jeff covers four approaches that can be taken to step debug code that will be running in a WebAssembly environment.

SEShopify Engineering·September 7, 2022Systems
Engineering — Cloudflare named a Leader by Gartner

Cloudflare named a Leader by Gartner

Gartner has recognised Cloudflare as a Leader in the 2022 "Gartner® Magic Quadrant™ for Web Application and API Protection (WAAP)" report that evaluated 11 vendors for their ‘ability to execute’ and ‘completeness of vision’

MTMichael TremanteMichael Tremante·September 6, 2022Engineering
Security — Join us for OctogatosConf 2022

Join us for OctogatosConf 2022

Live on September 15, 2022, with talks by industry experts in Spanish, Portuguese, and English, on topics including software development, security, technical project management, community, open source, professional development and best practices.

AGAndrea GriffithsAndrea Griffiths·September 6, 2022Security
SRE & Ops — Viewing the world as a computer: Global capacity management

Viewing the world as a computer: Global capacity management

Meta currently operates 14 data centers around the world. This rapidly expanding global data center footprint poses new challenges for service owners and for our infrastructure management systems. Systems like Twine, which we use to scale cluster management, and RAS, which handles perpetual region-wide resource allocation, have provided the abstractions and automation necessary for service […] Rea

CWChris Wiltz·September 6, 2022SRE & Ops
AI & ML — Recommend API

Recommend API

Slack, as a product, presents many opportunities for recommendation, where we can make suggestions to simplify the user experience and make it more delightful. Each one seems like a terrific use case for machine learning, but it isn’t realistic for us to create a bespoke solution for each. Instead, we developed a unified framework we…

KNKatrina Ni·September 6, 2022AI & ML
Engineering — Flutter For Front-End Web Developers

Flutter For Front-End Web Developers

I started as a front-end web developer and then became a Flutter developer. I think there were some concepts that helped me adopt Flutter easier. There were

ONObumuneme NwabudeObumuneme Nwabude·September 5, 2022Engineering
Engineering — Blocking Kiwifarms

Blocking Kiwifarms

We have blocked Kiwifarms. Visitors to any of the Kiwifarms sites that use any of Cloudflare's services will see a Cloudflare block page and a link to this post.

MPMatthew PrinceMatthew Prince·September 3, 2022Engineering
Networking — Log analytics using ClickHouse

Log analytics using ClickHouse

When a request at Cloudflare throws an error, information gets logged in our requests_error pipeline. The error logs are used to help troubleshoot customer-specific or network-wide issues

MPMonika, PradeepMonika, Pradeep·September 2, 2022Networking
Engineering — Release Radar

Release Radar

We’ve been gearing up to launch GitHub Universe 2022 and our community has been launching cool projects left right and center. These projects include everything from world-changing technology to developer…

MDMichelle DukeMichelle Duke·September 2, 2022Engineering
Databases — Git’s database internals V: scalability

Git’s database internals V: scalability

This fifth and final part of our blog series exploring Git’s internals shows several strategies for scaling your Git repositories that match related database sharding techniques.

DSDerrick StoleeDerrick Stolee·September 2, 2022Databases