
Lessons Learned From Running Apache Airflow at Scale - Shopify
Shopify shares some of the lessons we learned and solutions we built in order to run Airflow at scale.
1,745 articles published in 2022.

Shopify shares some of the lessons we learned and solutions we built in order to run Airflow at scale.

CSS is constantly evolving, and some cool and useful properties either go completely unnoticed or are not talked about as much as others for some reason or another. In this article, we’ll cover a fraction of those CSS properties and selectors.

When I considered joining Cloudflare, I recall consistently reading the message around “Helping to Build a Better Internet”. At first those words didn’t connect with me, but they sounded like an important mission.

Zeldman:

Each month, we highlight open source projects that have shipped major updates. These include everything from world-changing technology to developer tooling, and weekend projects. Here are our top staff picks…

Upgrade to GHES 3.2 or newer by June 3rd to continue using GitHub Connect.

Tether's March 2022 attestation, even if believed, shows that it became insolvent during the May 2022 crypto downturn.

Shopify’s now on a journey of mindfully unraveling these default office behaviors and replacing them with remote-focused ways of working.

When it comes to tools for publishing a blog, it can seem like there’s never a perfect solution that mixes customization with easy admin. In this article, we will see step-by-step how you can get the best of both worlds by using Ghost as a headless CMS for a Gatsby static site. We will cover all the tricky parts in-depth and show you can do everything for free.

The 66th edition of the Eurovision Song Contest, in Turin, Italy, had two semi-finals (May 10 and 12) and a final (May 14), all of them with highlights, including Ukraine’s victory. The Internet was impacted in more than one way, from whole countries to the fan and official broadcasters sites, but also video platforms.

Pint is a tool we developed to validate our Prometheus alerting rules and ensure they are always working

Don't you hate it when you load a website or web app, some content displays and then some images load — causing content to shift around? That's

Announcing a prototype screen reader beta

Mathematical expressions are key to information sharing amongst engineers, scientists, data scientists, and mathematicians. Today we are pleased to announce that math expressions can be rendered in Markdown on GitHub using $$ as a delimiter for code blocks with math content or the $ delimiter for inline math expressions.

Learn about what GitHub is doing to make their products more inclusive, and what’s next.


Developers are migrating from on-premises technology and embracing the benefits cloud infrastructure offers. Moreso, there is a rapid shift from a monolithic architecture to microservices architecture; this ensures that apps have higher availability, are simple to install, and easy to upgrade with the microservices architecture approach. In this post, we introduced Kubernetes to front-end engineer

Back in December 2021, I joined Cloudflare as a Software Development Intern on the Partnerships team to help improve the experience that Partners have when using the platform

I was fortunate last year to get approached by Shawn Wang (swyx) about doing some work for Temporal. The idea was to cast my creative eye over what was on the

With innersource, it’s important to measure both the amount of innersource activity and the quality of the code being created. Here’s how.

Explore how Shopify built a data pipeline using double entry transition tables to answer the question: how many Shopify merchants are using Shopify Balance?

We’re excited to announce the availability of Network Analytics Logs for maximum visibility into L3/4 traffic and DDoS attacks

In Cloudflare’s global network, every server runs the whole software stack. Therefore, it's critical that every server performs to its maximum potential capacity

After many announcements from Platform Week, we’re thrilled to make one more: our Spring Developer Challenge!

Utilizing icons in user interface elements is helpful. In addition to element labeling, icons can help reinforce a user element’s intention to users. But I

“Should I use pixels or rems?”. In this comprehensive blog post, we'll answer this question once and for all. You'll learn about the accessibility implications, and how to determine the best unit to use in any scenario.

In this episode, we ask how one man can go from designing websites for local bands to heading up Google Fonts Knowledge. Smashing’s Vitaly Friedman talks to Elliot Jay Stocks to find out.

Web design should be fun and accessible for anyone. After all, when we build a new website, our primary goal is to share our idea, product, or service with the world, not to dive into solving technical problems. Let’s take a closer look at how you can create your very own WordPress site up and running created and hosted with the [Elementor Cloud Website](https://elementor.com/features/cloud/?utm_s

We’re sharing updated performance metrics on our Workers platform. We’ve done an extensive benchmark of Cloudflare Workers vs Fastly’s Compute@Edge.

What happens to the Internet traffic in countries who observe Ramadan? Depending on the country, we see clear shifts and changing patterns in Internet use, particularly before dawn and after sunset.

Cloudflare is going to participate in the research and development of the core infrastructure that helps keep Ethereum secure, fast, as well as energy efficient for everyone

Today we are excited to announce that our Ethereum and IPFS gateways are publicly available to all Cloudflare customers for the first time

Today, we're announcing we're bridging the two. We will make it possible for our customers to serve their sites on the IPFS network

We've developed the IPFS Gateway monitor, an observability tool that runs various IPFS scenarios on a given gateway endpoint.

In this article, I will walk through creating global style variations in WordPress for block themes.


The innersource contribution percentage is the rate of contributions from people outside the team that originally authored the software. Let’s dive into what it can look like for your organization.

At GitHub we use GitHub to build our own products, and the new projects experience is no different. Check out how our team uses projects to build powerful project planning for developers.

GitHub’s Information Security Management System (ISMS) has been certified against ISO 27001:2013, an internationally recognized standard for security program best practices.

Shopify is investing on Ruby on Rails at scale by funding high-profile academics to focus their work towards Ruby and the needs of the Ruby community.

What makes the underused `Server-Timing` header uniquely powerful among all other response headers? We’ll rethink the expectation for using it exclusively for timing and see fast solutions for hard-to-solve monitoring challenges. In this article, Sean Roberts will provide you with a new perspective on Server-Timing as a tool to reach for, even if you’re not measuring time.

This is Part 1 of what will be a year-long series documenting our journey to re-architect our systems to be the best, fastest, most-scalable purge in the industry

Migrating millions of images into Cloudflare is now simple, fast and at the distance of a few clicks. The new Cloudflare Images Sourcing Kit Allows you to define your image sources, reuse them when you need to add new images or refresh existing ones

MailChannels has created an email sending service specifically for Cloudflare Workers that removes all the friction associated with sending emails

With Cloudflare Workers and Email Routing you now have a developer platform to implement any logic you ever wanted for programmatically handling incoming Emails.

Soon, Stream will auto-detect embedded captions and include it in the live stream delivered to your viewers

Starting today, in open beta, Cloudflare Stream supports video playback with sub-second latency over SRT or RTMPS at scale

Starting today, every Stream account can configure its own domain in the Stream dashboard.

Many Stream customers track video usage on a per-creator basis. Today, we are announcing creator management to make usage tracking much easier

You may wonder how adding a text shadow creates a cool hover effect but we’re actually not going to use "shadows" for these text hover effects.

An overview of Shopify Flow's new orchestration language Maestro, highlighting its design and implementation as well as how neatly it integrates with and addresses the requirements.

We waste so much today. One way of focusing on what truly matters is by identifying Top Tasks for yourself. In this article, Gerry McGovern will show you how to make tough decisions by focusing on the real, quantifiable evidence that will help create a better experience for your users.

Announcing the beta of Cloudflare Pub/Sub, our programmable, serverless message broker built on the open MQTT messaging standard

Learn how we built config versioning and staging for L7 configuration with HTTP Applications

Custom Domains are now available for your Workers. Hook up a Worker to any domain you own, and Cloudflare will handle making DNS records and issuing certificates on your behalf

Cloudflare’s Developer Platform Ecosystem continues to expand ensuring you can integrate with the tools you use, or want to use

Today, we’re delighted to introduce a new approach to NAT that solves the problems of traditional hardware and virtual solutions

Workers Analytics Engine is a new way to get telemetry about anything using Cloudflare Workers. Workers Analytics Engine provides time series analytics built for the serverless era

Introducing Pages Plugins – reusable and customizable chunks of runtime code that can be incorporated anywhere within your Pages application. Try one of the officially supported Plugins from our partners or build your own

You know Slinkys, right? That classic toy you knock down the stairs and it travels with its own momentum. Let's make one with pure CSS!