Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,847 articles
Performance — Citus: Sharding your first table

Citus: Sharding your first table

Here’s how to shard a table from scratch with Citus. Scale PostgreSQL DBs using a sharding approach. How to run a Citus Docker container.

HSHans-Jürgen SchönigHans-Jürgen Schönig·September 11, 2023Performance
Engineering — Building a ShopifyQL Code Editor - Shopify

Building a ShopifyQL Code Editor - Shopify

In October 2022, Shopify released ShopifyQL Notebooks, a first-party app that lets merchants analyze their shop data to make better decisions. It puts the power of ShopifyQL into merchants’ hands with a guided code editing experience. In order to provide a first-class editing experience, we turned to CodeMirror, a code editor framework built for the web. Out of the box, CodeMirror didn’t have supp

SEShopify Engineering·September 11, 2023Engineering
Design & UX — Rediscovering The Joy Of Design — Smashing Magazine

Rediscovering The Joy Of Design — Smashing Magazine

Pratik Joglekar takes a philosophical approach to remind designers about the lost joy within themselves by effectively placing massive importance on mindfulness, introspection, and forward-looking. Without joy, the work we do would feel meaningless. To prevent it from happening, check out a few ideas that would help rediscover that spark of joy.

PJPratik JoglekarPratik Joglekar·September 8, 2023Design & UX
AI & ML — Cloudflare One for Data Protection

Cloudflare One for Data Protection

This blog announces Cloudflare One for Data Protection — our unified suite to protect data everywhere across web, SaaS, and private applications. Built on and delivered across our entire global network, Cloudflare One’s data protection suite is architected for the risks of modern coding and AI

JCJames ChangJames Chang·September 7, 2023AI & ML
AI & ML — Using Chakra execution traces for benchmarking and network performance optimization

Using Chakra execution traces for benchmarking and network performance optimization

Meta presents Chakra execution traces, an open graph-based representation of AI/ML workload execution, laying the foundation for benchmarking and network performance optimization. Chakra execution traces represent key operations, such as compute, memory, and communication, data and control dependencies, timing, and resource constraints. In collaboration with MLCommons, we are seeking industry-wide

CWChris Wiltz·September 7, 2023AI & ML
SRE & Ops — Arcadia: An end-to-end AI system performance simulator

Arcadia: An end-to-end AI system performance simulator

We’re introducing Arcadia, Meta’s unified system that simulates the compute, memory, and network performance of AI training clusters. Extracting maximum performance from an AI cluster and increasing overall efficiency warrants a multi-input system that accounts for various hardware and software parameters across compute, storage, and network collectively. Arcadia gives Meta’s researchers and engin

CWChris Wiltz·September 7, 2023SRE & Ops
Career & Teams — Threads: The inside story of Meta’s newest social app

Threads: The inside story of Meta’s newest social app

Earlier this year, a small team of engineers at Meta started working on an idea for a new app. It would have all the features people expect from a text-based conversations app, but with one very key, distinctive goal – being an app that would allow people to share their content across multiple platforms. We […]

CWChris Wiltz·September 7, 2023Career & Teams
Frontend — Making Sense of React Server Components

Making Sense of React Server Components

This year, the React team unveiled something they've been quietly researching for years: an official way to run React components exclusively on the server. This is a significant paradigm shift, and it's caused a whole lot of confusion in the React community. In this tutorial, we'll explore this new world, and build an intuition for how it works, and how we can take advantage of it.

JWJosh W. Comeau·September 6, 2023Frontend
Engineering — My Summer Return Internship @ Slack: A Guide on Building on Past Experiences

My Summer Return Internship @ Slack: A Guide on Building on Past Experiences

Embarking on a journey Stepping out of SFO with the familiarity of the fogginess of the city, my story at Slack unfolds once again. As a return intern, I found myself prepped for another exciting summer, and this opportunity encompassed a renewed sense of anticipation — a mix between known pathways and new adventures. Returning…

ZSZac Sweers·September 6, 2023Engineering
Engineering — The creator economy goes global

The creator economy goes global

Stripe data shows that the creator economy has evolved but is still thriving. We’ve seen this evolution up close, as many of the largest creator platforms use Stripe Connect to onboard creators and pay out funds around the world.

EWEdwin WeeEdwin Wee·September 6, 2023Engineering
Career & Teams — What is it like to write code at Meta?

What is it like to write code at Meta?

Ever wonder what it’s like to write code at Meta’s scale? On the latest episode of the Meta Tech Podcast, Meta engineer Pascal Hartig (@passy) sits down with Dustin Shahidehpour and Katherine Zak, two software engineers at Meta, to talk about their careers and what it’s really like to ship code at Meta. Why does Meta have […]

CWChris Wiltz·September 5, 2023Career & Teams
AI & ML — Generating Real-Time Audio Sentiment Analysis With AI — Smashing Magazine

Generating Real-Time Audio Sentiment Analysis With AI — Smashing Magazine

In this article, Joas Pambou builds the tool to provide a sentiment score in **real-time** with enhanced user experience by providing multilingual support. You will use an OpenAI library called Whisper that transcribes audio files into text and detects the language, and Gradio, a UI framework, to establish the interface.

JPJoas PambouJoas Pambou·September 4, 2023AI & ML