Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,851 articles
Engineering — The 2030 Self-Driving Car Bet

The 2030 Self-Driving Car Bet

It’s my honor to announce that John Carmack and I have initiated a friendly bet of $10,000* to the 501(c)(3) charity of the winner’s choice: By January 1st, 2030, completely autonomous self-driving cars meeting SAE J3016 level 5 will be commercially available for passenger use in major cities. I am betting against, and John is betting for. By “completely autonomous,” per the SAE level 5 definition

JAJeff AtwoodJeff Atwood·March 4, 2022Engineering
Performance — Adding the V8 CPU Profiler to v8go - Shopify

Adding the V8 CPU Profiler to v8go - Shopify

V8 is Google’s open source high-performance JavaScript and WebAssembly engine written in C++. v8go is a library written in Go and C++ allowing users to execute JavaScript from Go using V8 isolates. Using Cgo bindings allows us to run JavaScript in Go at native performance. The v8go library, developed by Roger Chapman, aims to provide an idiomatic way for Go developers to interface with V8. As it t

SEShopify Engineering·March 4, 2022Performance
Engineering — Building Web Layouts For Dual-Screen And Foldable Devices — Smashing Magazine

Building Web Layouts For Dual-Screen And Foldable Devices — Smashing Magazine

Dual-screen devices have been on the market for nearly three years. In that time new web platform technologies have been built with developer feedback to enable layout on the web that adapts to these devices. These web platform capabilities integrate with existing concepts, such as the viewport and media queries, so that developers and designers can spend more time ideating about how to leverage t

SSStephanie StimacStephanie Stimac·March 3, 2022Engineering
Engineering — Our response to the war in Ukraine

Our response to the war in Ukraine

As the global response to the tragedies in Ukraine and other impacted regions continues to evolve, I wanted to share with our community an expansion of the message that I shared earlier this week with our Hubbers.

TDThomas DohmkeThomas Dohmke·March 2, 2022Engineering
Engineering — RubyConf 2021: The Talks You Might Have Missed - Shopify

RubyConf 2021: The Talks You Might Have Missed - Shopify

Shopify loves Ruby and opportunities to get together with other engineers who love Ruby to learn, share, and build relationships. In November, Rubyists from Shopify’s Ruby and Rails infrastructure teams gathered in Denver at RubyConf 2021 to immerse themselves in all things Ruby with a community of their peers. If you weren’t there or want to revisit the content, we’ve compiled a list of the talks

SEShopify Engineering·March 2, 2022Engineering
Frontend — New CSS Features In 2022 — Smashing Magazine

New CSS Features In 2022 — Smashing Magazine

2022 is shaping up to be a pretty great year for CSS, with a plethora of new features on the horizon. Some are already starting to land in browsers, others are likely to gain widespread browser support in 2022, while for one or two the process may be a little longer. In this article we’ll take a look at a few of them.

MBMichelle BarkerMichelle Barker·March 1, 2022Frontend
Languages — Why We Switched Our Data Orchestration Service

Why We Switched Our Data Orchestration Service

TL;DR Within Spotify, we run 20,000 batch data pipelines defined in 1,000+ repositories, owned by 300+ teams — daily. The majority of our pipelines rely on two tools: (for the Python folks) and (for the Java folks). In 2019, the data orchestration team at Spotify decided to move away from these tools. In this post, the team details why the decision was made, and the journey they took to make the t

GPGuillaume Perchais, Sr. Product Manager·March 1, 2022Languages
Engineering — Introducing Natural Language Search for Podcast Episodes

Introducing Natural Language Search for Podcast Episodes

Until recently, Search at Spotify relied mostly on term matching. For example, if you type the query “electric cars climate impact”, Elasticsearch will return search results that contain everything that has each of those query words in its indexed metadata (like in the title of a podcast episode).

ATAlexandre Tamborrino, Machine Learning Engineer·March 1, 2022Engineering
Engineering — Chantal Delfeld: Engineer

Chantal Delfeld: Engineer

My early mornings are spent running about after my children – getting them dressed, giving them breakfast and putting on their sunscreen, so they’re all ready for the day ahead. At 8am, I drive my daughter to preschool, while my mom looks after my one-year-old son – she’s been living with us since the start of the pandemic and has been a huge help when it comes to family life and childcare.

SESpotify Engineering·March 1, 2022Engineering
Engineering — Introducing NerdOut@Spotify: A New Podcast for Developers

Introducing NerdOut@Spotify: A New Podcast for Developers

TL;DR For years, Spotify’s official engineering blog has been giving you a peek behind the curtain at Spotify R&D. Today, we’re announcing , our new R&D podcast that gives you another view into our tech world. In each episode I’ll talk with Spotify developers about challenging tech problems and give you a firsthand look into what we’re doing, what we’re building, and what we’re nerding out about a

DZDave Zolotusky, Principal Engineer·March 1, 2022Engineering
Distributed — Comparing Quantiles at Scale in Online A/B Testing

Comparing Quantiles at Scale in Online A/B Testing

TL;DR: Using the properties of the Poisson bootstrap algorithm and quantile estimators, we have been able to reduce the computational complexity of Poisson bootstrap difference-in-quantiles confidence intervals enough to unlock bootstrap inference for almost arbitrary large samples. At Spotify, we can now easily calculate bootstrap confidence intervals for difference-in-quantiles in A/B tests with

MSMårten Schultzberg and Sebastian Ankargren·March 1, 2022Distributed
SRE & Ops — Incident Report: Spotify Outage on March 8, 2022

Incident Report: Spotify Outage on March 8, 2022

On March 8, we experienced a global outage triggered by issues in a cloud-hosted service discovery system used at Spotify. We were made aware of issues with login at 18:12 UTC / 13:12 ET and started implementing fixes to critical systems at 18:39 UTC / 13:39 ET. This outage affected our users and we apologize for the inconvenience it may have caused. Our service has now fully recovered.

SESpotify Engineering·March 1, 2022SRE & Ops