Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,845 articles
Distributed — Stuff The Internet Says On Scalability For December 19th, 2020 - High Scalability -

Stuff The Internet Says On Scalability For December 19th, 2020 - High Scalability -

Hey, it's HighScalability time once again! NASA Do you like this sort of Stuff? Without your support on Patreon this Stuff won't happen. Know someone who could benefit from becoming one with the cloud? I wrote Explain the Cloud Like I'm 10 just for them. On Amazon it has 212 mostly 5 star reviews. Here's a load-balanced and fault-tolerant review: Number Stuff: * 1 billion: TikTok users in half the

HSHigh Scalability·December 19, 2020Distributed
Distributed — Computing Euclidean distance on 144 dimensions

Computing Euclidean distance on 144 dimensions

Last year we deployed a CSAM image scanning tool. This is so cool! Image processing is always hard, and deploying a real image identification system at a Cloudflare scale is no small achievement! But we hit a problem - the matching algorithm was too slow for our needs.

MMMarek MajkowskiMarek Majkowski·December 18, 2020Distributed
Career & Teams — A quirk in the SUNBURST DGA algorithm

A quirk in the SUNBURST DGA algorithm

On Wednesday, December 16, the RedDrip Team from QiAnXin Technology released their discoveries (tweet, github) regarding the random subdomains associated with the SUNBURST malware which was present in the SolarWinds Orion compromise. I

CCloudflare·December 18, 2020Career & Teams
Engineering — Optimizing Image Depth

Optimizing Image Depth

Something I learned (or, I guess, re-learned) this year is how important it is to pay close attention to the bit depth of images. Way back in the day, we used

EMEric MeyerEric Meyer·December 18, 2020Engineering
Engineering — Change vs. Inertia

Change vs. Inertia

Recently, I've become more deeply aware of the inherent tension between change and inertia, as it applies to the evolution and use of web technologies. These

KSKyle Simpson·December 18, 2020Engineering
Languages — Learn about ghapi, a new third-party Python client for the GitHub API

Learn about ghapi, a new third-party Python client for the GitHub API

Learn about ghapi, a third-party Python library and CLI client for the GitHub API. It includes tab-completion, integrated documentation and automatic pagination of responses. ghapi automatically manages required headers, query strings, route parameters, post data, and much more.

HHHamel HusainHamel Husain·December 18, 2020Languages
Security — Happy anniversary GitHub Security Lab!

Happy anniversary GitHub Security Lab!

Last year at GitHub Universe, we introduced the GitHub Security Lab, which is committed to contributing resources, tooling, bounties, and security research to secure the open source ecosystem. We know…

JCJamie CoolJamie Cool·December 18, 2020Security
Engineering — What's Old is New

What's Old is New

This year, I learned a lot about how "old" tricks can solve a lot of modern problems if you use the right tools. Following the growth of Jamstack-style

CWCassidy WilliamsCassidy Williams·December 17, 2020Engineering
Security — Shifting supply chain security left with dependency review

Shifting supply chain security left with dependency review

Dependency review allows you to easily understand your dependencies before you introduce them to your environment. As part of a pull request, you can see what dependencies you’re introducing, changing, or removing, and information about their vulnerabilities, age, usage, and license.

WBWilliam BartholomewWilliam Bartholomew·December 17, 2020Security
Engineering — Commits are snapshots, not diffs

Commits are snapshots, not diffs

Git has a reputation for being confusing. Users stumble over terminology and phrasing that misguides their expectations. This is most apparent in commands that “rewrite history” such as git cherry-pick or git rebase. In my experience,…

DSDerrick StoleeDerrick Stolee·December 17, 2020Engineering
Engineering — No cookie for you

No cookie for you

The developer community remains the heart of GitHub, and we’re committed to respecting the privacy of developers using our product.

NFNat FriedmanNat Friedman·December 17, 2020Engineering
Networking — Evenstar: The road to an alternative infra supply chain for RAN

Evenstar: The road to an alternative infra supply chain for RAN

Together with mobile network operators Airtel and Vodafone, and technology partners ADI, Altiostar, Baicells, Flex, Mavenir, MTI, Parallel Wireless, and Xilinx, we are focused on building general-purpose radio access network (RAN) reference designs for 4G and 5G networks in the Open RAN ecosystem. This work is being done as part of the Evenstar program. The […]

MEMeta Engineering·December 17, 2020Networking
AI & ML — On the value of diversified recommendations

On the value of diversified recommendations

One of the biggest questions faced by the recommendation systems community is whether recommendation systems should be solely evaluated by their predictive accuracy, or also focus on other factors such as preference broadening. In order to appreciate the importance of this question, let us look at a couple of simulated scenarios in a dynamic setting. User […]

CWChris Wiltz·December 17, 2020AI & ML
Performance — Search Engine Optimization Checklist (PDF) — Smashing Magazine

Search Engine Optimization Checklist (PDF) — Smashing Magazine

Implementing best SEO practice can produce immediate results, but long-term performance requires long-term maintenance. Besides, the journey is more important than the destination, isn’t it? The most beautiful, spectacular site in the world won’t do anyone much good if people can’t find it on Google (or Bing, or DuckDuckGo). This is not an exhaustive list, but hopefully there is enough to help you

FOFrederick O BrienFrederick O Brien·December 17, 2020Performance