Implementing Raft: Part 5 - Exactly-once delivery - Eli Bendersky's website
When net zero isn’t enough: Deepening our commitment to climate action by investing in the future
With our biggest ever investment in sustainability, Figma ensures that vanguard technologies the future depends on will continue to scale.
Managing Slack Connect
Slack Connect, AKA shared channels, allows communication between different Slack workspaces, via channels shared by participating organizations. Slack Connect has existed for a few years now, and the sheer volume of channels and external connections has increased significantly since the launch. The increased volume introduced scaling problems, but also highlighted that not all external connections
How We Automated Content Marketing to Acquire Users at Scale
Spotify runs paid marketing campaigns across the globe on various digital ad platforms like Facebook, Google UAC (display banners), TikTok, and more. Being efficient with our marketing budget is critical for maximizing the return on ad spend so that we can continue to develop ads that communicate the value of Spotify to users and non-users alike. Running and managing paid marketing campaigns at a
Spend Management: Realtime Usage Alerts, SMS Notifications, and Project Pausing
New controls to help you safely scale your projects and prevent unexpected bills.
Managing Software at Scale: Kelsey Hightower Talks with Niklas Gustavsson about Fleet
How does Spotify manage a sprawling tech ecosystem made up of 500+ squads managing over 10,000 software components in production? Last November, Google Cloud distinguished engineer Kelsey Hightower met with Spotify chief architect Niklas Gustavsson at Spotify’s office in Gothenburg, Sweden, to talk about just that.
Switching Build Systems, Seamlessly
At Spotify, we have experimented with the build system since 2017. Over the years, the project has matured, and support for more languages and ecosystems have been added, thanks to the open source community and its maintainers at Google. In 2020, it became clear that the future of our client development required a unified build system that would scale well with our polyglot, multiplatform, and mul
Executing Cron Scripts Reliably At Scale
Cron scripts are responsible for critical Slack functionality. They ensure reminders execute on time, email notifications are sent, and databases are cleaned up, among other things. Over the years, both the number of cron scripts and the amount of data these scripts process have increased. While generally these cron scripts executed as expected, over time…
Improving Worker Tail scalability
We’re excited to announce improvements to Workers Tail that means it can now be enabled for Workers at any size and scale
Zero Configuration Service Mesh with On-Demand Cluster Discovery
Netflix’s service mesh adoption: history, motivations, and how we worked with the Envoy community on a streamlining service mesh adoption in complex microservice environments
Unleashing GitHub Codespaces templates to ignite your development
Learn how to leverage templating features in GitHub Codespaces to streamline your project setup, improve consistency, and simplify collaboration within your development team.
Coming Soon: Confidence — An Experimentation Platform from Spotify
TL;DR: Spotify is releasing a new commercial product for software development teams: a version of our homegrown experimentation platform that we’re calling . Based on everything we’ve learned over the last 10+ years about what it takes to enable experimentation at scale, the platform makes it easy for teams to set up, run, coordinate, and analyze their own user tests — from simple A/B testing to t
Scaling merge-ort across GitHub
GitHub switched to performing merges and rebases using merge-ort. Come behind the scenes to see why and how we made this change.
GitHub Repository Rules are now generally available
Repository rules provide an easy, flexible way to define branch protections and ensure consistency in code across repositories.
Gossip Protocol Explained - High Scalability -
You can subscribe to the system design newsletter to excel in system design interviews and software architecture. The original article was published on systemdesign.one website. What Is Gossip Protocol? The typical problems in a distributed system are the following [1], [11]: * maintaining the system state (liveness of nodes) * communication between nodes The potential solutions to these problems
GitHub merge queue is generally available
Supercharge pull request merges on your busiest branches by enabling your team to queue.
How To Create A Rapid Research Program To Support Insights At Scale — Smashing Magazine
Accelerate your organization’s growth and innovation with the power of Rapid Research. From inception to implementation, here is the step-by-step roadmap on how to build the program from scratch and uncover the untapped ROI opportunities waiting to propel your initiatives to new heights.
Meet Success At Scale, A New Smashing Book By Addy Osmani — Smashing Magazine
Meet “Success At Scale”, our upcoming book with best-practice case studies from industry experts. Print shipping in early March 2024. eBook now available. Pre-order the book.
Migrating Critical Traffic At Scale with No Downtime — Part 2
Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience. Behind these perfect moments of entertainment…
Building a culture of innovation in your business with GitHub
Consider the typical software development practices in an organization. Projects are commonly closed, and causes friction across engineering teams. But open source communities work asynchronously, openly, remotely and at global-scale. What if our internal teams could reuse those same practices?
Quality software at scale with Vercel Spaces
Spaces from Vercel
Fleet Management at Spotify (Part 3): Fleet-wide Refactoring
This is part 3 in our series on Fleet Management at Spotify and how we manage our software at scale. See also and .
Fleet Management at Spotify (Part 2): The Path to Declarative Infrastructure
This is part 2 in our series on Fleet Management at Spotify and how we manage our software at scale. See also and .
Multi-repository enablement: effortlessly scale code scanning across your repositories
We’ve gotten great feedback on default setup, a simple way to set up code scanning on your repository. Now, you have the ability to use default setup across your organization’s repositories, in just one click.
Fleet Management at Spotify (Part 1): Spotify’s Shift to a Fleet-First Mindset
This is part 1 in our series on Fleet Management at Spotify and how we manage our software at scale. See also and .
See you at SCaLE! 🐧
SCaLE is the largest community-run open-source and free software conference in North America. It takes place next week in Pasadena, CA from March 9-12, 2023 and we’ll be there!
Consistent hashing algorithm - High Scalability -
You can subscribe to the system design newsletter to excel in system design interviews and software architecture. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work? At a high level, consistent hashing performs the following operations: 1. The output of the hash function is placed on a virtual ring structure (known as the ha
Hakana: Taking Hack Seriously
TL; DR: We’re announcing a new open source type checker for Hack, called Hakana. Slack launched in 2014, built with a lot of love and also a lot of PHP code. We started migrating to a different language called Hack in 2016. Hack was created by Facebook after they had struggled to scale their operations…
Skilling for the future: How GitHub is advancing diversity, equity, and inclusion within open source communities
In the coming months, we’re scaling, expanding, and launching new programming to further DEI within open source communities.
Intelligent, automatic restarts for unhealthy Kafka consumers
At Cloudflare, we take steps to ensure we are resilient against failure at all levels of our infrastructure. This includes Kafka, which we use for critical workflows such as sending time-sensitive emails and alerts.
Introducing Waiting Room Bypass Rules
Waiting Room now offers customers more fine-tuned control over what traffic a waiting room covers. Queue only the traffic you want to with Bypass Waiting Room Rules, now available to all Enterprise customers with an Advanced Purchase of Waiting Room.
What is Cloud Computing? According to ChatGPT. - High Scalability -
DALL-E picture generated from the answer. I was curious, given all the ChatGPT love, what it would make of some of our favorite topics. I was both impressed and unimpressed. Impressed. ChatGPT instantly generated an response that might make a good answer in a Miss Universe contest. You know, the kind of answer delivered with a radiant smile calculated to offend no one yet still sounds comprehensiv
Planning in Bets: Risk Mitigation at Scale - Shopify
What do you do with a finite amount of time to deal with an infinite number of things that can go wrong? This post breaks down a high-level risk mitigation process into four questions that can be applied to nearly any scenario in order to help you make the best use of your time and resources available.
Stuff The Internet Says On Scalability For December 2nd, 2022 - High Scalability -
Never fear, HighScalability is here! 1958: An engineer wiring an early IBM computer 2021: An engineer wiring an early IBM quantum computer. @enclanglement My Stuff: * I'm proud to announce a completely updated and expanded version of Explain the Cloud Like I'm 10! This version adds 2x more coverage, with special coverage of AWS, Azure, GCP, and K8s. It has 482 mostly 5 star reviews on Amazon. Here
Shipping Spotify’s Culture: 5 Plugins (and 4 Principles) for Supercharging Developer Experience at Scale
ICYMI Spotify officially began selling enterprise software today: the bundle subscription. Some of these commercial plugins began life as internal tools, built by Spotify developers, for Spotify developers. Other plugins in the bundle are brand new to the Backstage platform. But they all embody our ways of working — our secret sauce for improving developer experience at scale. And now that we’re s
Using Server Sent Events to Simplify Real-time Streaming at Scale - Shopify
We walk through how we implemented an SSE server that's scalable and load-balanced to simplify and improve a real-time data visualization application.
Spice up your sites on Cloudflare Pages with Pages Functions General Availability
Pages is officially a full stack platform with Pages Functions now Generally Available. Pages is harnessing the power and scalability of Workers and specializing them to align with the Pages developer experience.
Welcome to the Supercloud (and Developer Week 2022)
Every developer wants to get code running on one machine and perfect it. It’s so much easier to work that way. We just happen to have one machine that scales to the size of the Internet: a global, distributed, supercomputer. It’s our Supercloud, and we build our own products on it, and you can too
Build applications of any size on Cloudflare with the Queues open beta
Cloudflare Queues enables developers to build performant and resilient distributed applications that span the globe. Any developer with a paid Workers plan can enroll in the Open Beta and start building today!
Cloudflare Workers scale too well and broke our infrastructure, so we are rebuilding it on Workers
DevCycle re-architected their feature management tool using Workers for improved scalability
The Cloud is Not a Railroad - An Argument Against the Vertical Separation of Cloud Providers - High Scalability -
There's a move to regulate cloud providers by vertically separating the services they offer. Like railroads of yore, who were not allowed to provide freight services on top of their base services, cloud providers would not be allowed to provide services on top of their base platform services. Vertical separation would be new to the cloud industry. Is it a good idea? Would it actually solve any pro
Adding Fluid Typography Support to WordPress Block Themes
Fluid typography is a fancy way of “describing font properties, such as size or line height, that scale fluidly according to the size of the viewport”. It’s
Leading venture capital firms to provide up to $1.25 BILLION to back startups built on Cloudflare Workers
Building and scaling a startup is hard work. Apply to the $1.25BN Workers Launchpad funding program for an opportunity to pitch leading VCs and other perks
Cloudflare Queues: globally distributed queues without the egress fees
Cloudflare Queues is a message queuing service that allows applications to reliably send and receive messages using Cloudflare Workers
Stream Live is now Generally Available
Stream Live is now out of beta, available to everyone, and ready for production traffic at scale
Lessons Learned from Algorithmic Impact Assessments in Practice
TL;DR Understanding algorithmic impact is critical to building a platform that serves hundreds of millions of listeners and creators every day. Our approach includes a combination of centralized and distributed efforts, which drives adoption of best practices across the entire organization — from researchers and data scientists to the engineer pushing the code.
Scaling Translations at Spotify
Last year, we added support for 36 new languages to our products in one go, for a total of 62 languages. This article describes how we delivered on such an immense localization effort at Spotify. We called the project Scaling Translations.
Using Apache Kafka to process 1 trillion inter-service messages
We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post
What it Took to Scale Spotify’s Marketing Efforts
At Spotify, we’ve tried to uphold the tradition of running one major holiday marketing campaign at the end of each year. The campaigns typically run on various platforms such as the Spotify Homepage and the Premium page.
What’s new in Codespaces for Organizations
We’re releasing exciting functionalities that will enable organizations to confidently manage and scale with Codespaces.
Building Background Effects for Clips
Last September, Slack released Clips, allowing users to capture video, audio, and screen recordings in messages to help distributed teams connect and share their work. We’ve continued iterating on Clips since its release, adding thumbnail selection, background blur, and most recently, background image replacement. This blog post provides a deep dive into our implementation of…
Full-scale expression with Grilli Type
A conversation with Thierry Blancpain from Grilli Type
Lessons Learned From Running Apache Airflow at Scale - Shopify
Shopify shares some of the lessons we learned and solutions we built in order to run Airflow at scale.
Scaling Slack’s Mobile Codebases: Modernization
In the first two posts about the Duplo initiative, we described why we decided to revamp our mobile codebases, the initial phase to clean up tech debt, and our efforts to modularize our iOS and Android codebases (post 1, post 2). In this final post, we will discuss the last theme of the Duplo initiative,…
4 ways we use GitHub Actions to build GitHub
From automating builds and releases to taking care of large-scale regression testing, here are a few ways we use GitHub Actions to build GitHub.
Handling Flaky Tests at Scale: Auto Detection & Suppression
At Slack, the goal of the Mobile Developer Experience Team (DevXp) is to empower developers to ship code with confidence while enjoying a pleasant and productive engineering experience. We use metrics and surveys to measure productivity and developer experience, such as developer sentiment, CI stability, time to merge (TTM), and test failure rate. The DevXp…
Scaling Slack’s Mobile Codebases: Modularization
In the first post about the Duplo initiative, we discussed the reasons for launching a project to revamp Slack’s mobile codebases, and what we accomplished in Duplo’s initial Stabilization phase. This post will explore modularization, and then there will be a third post to describe how we modernized our codebase and the overall results of…
Introducing the GHES repository cache
If you’re a GHES customer with heavy read traffic on your monorepo, check out the repository cache, especially if you have CI workloads distributed around the world.
Comparing Quantiles at Scale in Online A/B Testing
TL;DR: Using the properties of the Poisson bootstrap algorithm and quantile estimators, we have been able to reduce the computational complexity of Poisson bootstrap difference-in-quantiles confidence intervals enough to unlock bootstrap inference for almost arbitrary large samples. At Spotify, we can now easily calculate bootstrap confidence intervals for difference-in-quantiles in A/B tests with