Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,670 articles
SRE & Ops — Your DevOps guide to GitHub Universe

Your DevOps guide to GitHub Universe

GitHub Universe is almost here. For more on what to expect from this year’s stream, we sat down with virtual host, Brian Douglas, for a quick Q&A on GitHub Actions,…

GMGrace MadlingerGrace Madlinger·December 4, 2020SRE & Ops
Performance — A World Rendered Beautifully: The Making of the BFCM 3D Data Visualization - Shopify

A World Rendered Beautifully: The Making of the BFCM 3D Data Visualization - Shopify

By Mikko Haapoja and Stephan Leroux 2020 Black Friday Cyber Monday (BFCM) is over, and another BFCM Globe has shipped. We’re extremely proud of the globe, it focused on realism, performance, and the impact our merchants have on the world. The Black Friday Cyber Monday Live Map We knew we had a tall task in front of us this year, building something that could represent orders from our one million m

SEShopify Engineering·December 4, 2020Performance
Distributed — Data Mesh Principles and Logical Architecture

Data Mesh Principles and Logical Architecture

Our aspiration to augment and improve every aspect of business and life with data, demands a paradigm shift in how we manage data at scale. While the technology advances of the past decade have addressed the scale of volume of data and data processing compute, they have failed to address scale in other dimensions: changes in the data landscape, proliferation of sources of data, diversity of data u

ZDZhamak Dehghani·December 3, 2020Distributed
Security — Applying DevSecOps to your software supply chain

Applying DevSecOps to your software supply chain

To best apply DevSecOps principles to improve the security of your supply chain, you should ask your developers to declare your dependencies in code; and in turn provide your developers with maintained ‘golden’ artifacts and automated downstream actions so they can focus on code.

MKMaya KaczorowskiMaya Kaczorowski·December 3, 2020Security
SRE & Ops — The evolving role of operations in DevOps

The evolving role of operations in DevOps

GitHub’s team delves into answering the question “what are operations roles in the development and operations (DevOps) environments”. From automating the role of QA in DevOps and more for smaller, faster delivery cycles.

JMJared MurrellJared Murrell·December 3, 2020SRE & Ops
Networking — SuperCell: Reaching new heights for wider connectivity

SuperCell: Reaching new heights for wider connectivity

As part of our efforts to help expand connectivity around the world, Facebook Connectivity has been prototyping SuperCell, a wide-area coverage solution for increasing mobile connectivity in rural communities. Now, after working with telecom industry partners to conduct several trials and data analyses, we’re ready to share what we’ve learned. Rather than produce this solution […]

CWChris Wiltz·December 3, 2020Networking
Distributed — Capacity Planning at Scale - Shopify

Capacity Planning at Scale - Shopify

We cover our approaches to capacity planning, and how we rolled it out across the org and to dozens of teams. We’ll also share how we validated our capacity plans with scalability tests to make sure they work.

SEShopify Engineering·December 3, 2020Distributed
Frontend — CommonMark: A Formal Specification For Markdown — Smashing Magazine

CommonMark: A Formal Specification For Markdown — Smashing Magazine

Markdown is a powerful markup language that allows editing and formatting in plain text format that can then be parsed and rendered as HTML. It has a declarative syntax that is both powerful and easy to learn for technical and non-technical folks. However, due to the consequential ambiguities in its original specification, there have been a number of distinct [flavors (or custom versions)](https:/

AAAdebiyi AdedotunAdebiyi Adedotun·December 3, 2020Frontend
Engineering — GitHub Availability Report: November 2020

GitHub Availability Report: November 2020

Introduction In November, we experienced two incidents resulting in significant impact and degraded state of availability for issues, pull requests, and GitHub Actions services. November 2 12:00 UTC (lasting 32…

KBKeith BallingerKeith Ballinger·December 2, 2020Engineering
Engineering — The State of the Octoverse 2020

The State of the Octoverse 2020

Change is inevitable, and this year, it has been inescapable. We’ve had to find new ways to relate, learn, and balance both work and life at home. One thing has…

NFNicole ForsgrenNicole Forsgren·December 2, 2020Engineering
Engineering — Designing An Attractive And Usable Data Importer For Your App — Smashing Magazine

Designing An Attractive And Usable Data Importer For Your App — Smashing Magazine

Even though the development of a data importer is a complex matter, you don’t want your users’ experience with it to be just as complex or complicated. The second they experience any friction or fault in data onboarding, the chances of them bailing from the software will skyrocket. So, in this post, we’re going to focus on how best to present your data importer to users.

SSSuzanne ScaccaSuzanne Scacca·December 2, 2020Engineering
Engineering — Painting With the Web

Painting With the Web

Matthias Ott, comparing how painter Gerhard Richter paints (do stuff, step back, take a look) to what can be the website building process and what can wreck it:

CCChris Coyier·December 1, 2020Engineering
Design & UX — Under-Engineered Responsive Tables

Under-Engineered Responsive Tables

I first blogged about responsive data tables in 2011. When responsive web design was first becoming a thing, there were little hurdles like data tables that

CCChris Coyier·December 1, 2020Design & UX