Home/2023
Archive

Year 2023

1,342 articles published in 2023.

SRE & Ops — Slack’s Migration to a Cellular Architecture

Slack’s Migration to a Cellular Architecture

Summary In recent years, cellular architectures have become increasingly popular for large online services as a way to increase redundancy and limit the blast radius of site failures. In pursuit of these goals, we have migrated the most critical user-facing services at Slack from a monolithic to a cell-based architecture over the last 1.5 years.…

SZStephan Zuercher·August 22, 2023SRE & Ops
Security — Application Security Report: Q2 2023

Application Security Report: Q2 2023

We are back with a quarterly update of our Application Security report. Read on to learn about new attack trends and insights visible from Cloudflare’s global network

MTMichael Tremante, David BelsonMichael Tremante, David Belson·August 21, 2023Security
Design & UX — Better Context Menus With Safe Triangles — Smashing Magazine

Better Context Menus With Safe Triangles — Smashing Magazine

Discover how to improve the user experience of nested menus and tackle a minor yet common issue with them when the user’s pointer leaves the menu item for a moment, and the nested menu goes away, requiring the user to re-hover and try again. A well-known concept called the “safe triangle” solves this problem.

CACosta AlexoglouCosta Alexoglou·August 21, 2023Design & UX
Security — mTLS: When certificate authentication is done wrong

mTLS: When certificate authentication is done wrong

In this post, we’ll deep dive into some interesting attacks on mTLS authentication. We’ll have a look at implementation vulnerabilities and how developers can make their mTLS systems vulnerable to user impersonation, privilege escalation, and information leakages.

MSMichael StepankinMichael Stepankin·August 17, 2023Security
SRE & Ops — The Swedbank Outage shows that Change Controls don't work - High Scalability -

The Swedbank Outage shows that Change Controls don't work - High Scalability -

This week I’ve been reading through the recent judgment from the Swedish FSA on the Swedbank outage. If you’re unfamiliar with this story, Swedbank had a major outage in April 2022 that was caused by an unapproved change to their IT systems. It temporarily left nearly a million customers with incorrect balances, many of whom were unable to meet payments. After investigation, the regulator found th

BJBruce Johnston·August 16, 2023SRE & Ops
Security — Curbing Connection Churn in Zuul - Netflix TechBlog

Curbing Connection Churn in Zuul - Netflix TechBlog

When Zuul was designed and developed, there was an inherent assumption that connections were effectively free, given we weren’t using mutual TLS (mTLS). It’s built on top of Netty, using event loops…

NTNetflix TechBlog·August 16, 2023Security
Engineering — Release Radar

Release Radar

After the last Release Radar, I promised the next one wouldn’t be far away, so here it is. This is the low down on some of the best open source…

MDMichelle DukeMichelle Duke·August 15, 2023Engineering
Security — Hardening repositories against credential theft

Hardening repositories against credential theft

Some best practices and important defenses to prevent common attacks against GitHub Actions that are enabled by stolen personal access tokens, compromised accounts, or compromised GitHub sessions.

MMMatthew MasarikMatthew Masarik·August 15, 2023Security
SRE & Ops — Introducing Immortal Objects for Python

Introducing Immortal Objects for Python

Instagram has introduced Immortal Objects – PEP-683 – to Python. Now, objects can bypass reference count checks and live throughout the entire execution of the runtime, unlocking exciting avenues for true parallelism. At Meta, we use Python (Django) for our frontend server within Instagram. To handle parallelism, we rely on a multi-process architecture along with […]

CWChris Wiltz·August 15, 2023SRE & Ops
Languages — Wasm core dumps and debugging Rust in Cloudflare Workers

Wasm core dumps and debugging Rust in Cloudflare Workers

Debugging Rust and Wasm with Cloudflare Workers involves a lot of the good old time-consuming and nerve-wracking printf'ing strategy. What if there’s a better way? This blog is about enabling and using Wasm core dumps and how you can easily debug Rust in Cloudflare Workers

SCSven, CelsoSven, Celso·August 14, 2023Languages
Engineering — Debug Queues from the dash: send, list, and ack messages

Debug Queues from the dash: send, list, and ack messages

Today, we are thrilled to share that customers can now debug their Queues directly from the Cloudflare dashboard. This new feature allows customers to send, list, and acknowledge messages in their Queues from the Cloudflare dashboard, enabling a more user-friendly way to interact with their Queues

EEmilieEmilie·August 11, 2023Engineering
Performance — Running A Page Speed Test: Monitoring vs. Measuring — Smashing Magazine

Running A Page Speed Test: Monitoring vs. Measuring — Smashing Magazine

What does your performance “stack” look like? There are all kinds of tools available for measuring page speed, but what data and assumptions do they use to measure performance? And speaking of *measuring* performance, there’s quite a difference between that and *monitoring* performance. Let’s dig in!

GGGeoff GrahamGeoff Graham·August 10, 2023Performance
AI & ML — Scaling the Instagram Explore recommendations system

Scaling the Instagram Explore recommendations system

Explore is one of the largest recommendation systems on Instagram. We leverage machine learning to make sure people are always seeing content that is the most interesting and relevant to them. Using more advanced machine learning models, like Two Towers neural networks, we’ve been able to make the Explore recommendation system even more scalable and […]

CWChris Wiltz·August 9, 2023AI & ML
Security — How Meta is improving password security and preserving privacy

How Meta is improving password security and preserving privacy

Meta is developing new privacy-enhancing technologies (PETs) to innovate and solve problems with less data. These technologies enable teams to build and launch privacy-enhanced products in a way that’s verifiable and safeguards user data. Using state-of-the-art cryptographic techniques, we have developed Private Data Lookup (PDL) that allows users to privately query a server-side data set. […] Rea

MEMeta Engineering·August 8, 2023Security
SRE & Ops — Fixit 2: Meta’s next-generation auto-fixing linter

Fixit 2: Meta’s next-generation auto-fixing linter

Fixit is dead! Long live Fixit 2 – the latest version of our open-source auto-fixing linter. Fixit 2 allows developers to efficiently build custom lint rules and perform auto-fixes for their codebases. Fixit 2 is available today on PyPI. Python is one of the most popular languages in use at Meta. Meta’s production engineers (PEs) […]

CWChris Wiltz·August 7, 2023SRE & Ops
SRE & Ops — Using short-lived certificates to protect TLS secrets

Using short-lived certificates to protect TLS secrets

Short-lived certificates (SLCs) are part of our latest efforts to further secure our Transport Layer Security (TLS) private keys on our edge networks. SLCs have a very short exposure compared to traditional certificates and lower the chances of a compromised private key being abused. Implementing SLCs has required us to address tradeoffs between operability and […]

CWChris Wiltz·August 7, 2023SRE & Ops
AI & ML — Using Friction As A Feature In Machine Learning Algorithms — Smashing Magazine

Using Friction As A Feature In Machine Learning Algorithms — Smashing Magazine

Friction often has a negative connotation in user experience design, but it actually has many benefits. Its best-known use case is mitigating unintended consequences in high-risk scenarios, yet it has a new place in the age of artificial intelligence. Adding strategic friction to interfaces can lead to profound efficiency gains in machine learning algorithms.

MPMaximillian PirasMaximillian Piras·August 7, 2023AI & ML
Engineering — Is your work style written in the stars?

Is your work style written in the stars?

Product Research Intern Jacky Huang and Software Engineer Willy Wu discuss their FigJam widget that matches up your work style with the stars, and how fun is the future of collaborative work.

HLHerbert Lui·August 4, 2023Engineering
Engineering — A checklist and guide to get your repository collaboration-ready

A checklist and guide to get your repository collaboration-ready

In the world of software development, collaboration can make the difference between a brittle last-minute release and a reliable, maintainable, pain-free project. Whether you’ve been coding for a day or a decade, your colleagues are there to help strengthen your work. But they can only help if you’ve given them the tools to do so.

JPJon PeckJon Peck·August 4, 2023Engineering
Performance — How We Optimized Performance To Serve A Global Audience — Smashing Magazine

How We Optimized Performance To Serve A Global Audience — Smashing Magazine

Liran Cohen and the team at Bookaway, a travel booking service, dramatically improved their site’s performance by auditing Core Web Vitals. In this article, Liran shares his team’s process for auditing and monitoring Web Vitals and the effort it took to dramatically improve Bookaway’s performance — and the benefits that came with it.

LCLiran CohenLiran Cohen·August 3, 2023Performance