Techreport blog

Engineering Insights & Guides

The best problem-solving writing in software engineering — databases, performance, security, frontend and distributed systems, in one feed.

11,842 articles
AI & ML — From Black Box to Blueprint

From Black Box to Blueprint

A common enterprise problem: crucial legacy systems become “black boxes”—key to operations but opaque and risky to touch. We worked with a client to use AI-assisted reverse engineering to reconstruct functional specifications from UI elements, binaries, and data lineage to overcome analysis paralysis. We developed a methodical “multi-lens” approach—starting from visible artifacts, enriching increm

TPThiyagu Palanisamy and Chandirasekar Thiagarajan·August 28, 2025AI & ML
AI & ML — Some thoughts on LLMs and Software Development

Some thoughts on LLMs and Software Development

I’m about to head away from looking after this site for a few weeks (part vacation, part work stuff). As I contemplate some weeks away from the daily routine, I feel an urge to share some scattered thoughts about the state of LLMs and AI.

MFMartin Fowler·August 28, 2025AI & ML
AI & ML — How Cloudflare runs more AI models on fewer GPUs: A technical deep-dive

How Cloudflare runs more AI models on fewer GPUs: A technical deep-dive

In order to support a growing catalog of AI models while maximizing GPU utilization, Cloudflare built an internal platform called Omni. This platform uses lightweight isolation and memory over-commitment to run multiple AI models on a single GPU, allowing us to serve inference requests closer to users and improve overall availability across our network.

SMSven, MariSven, Mari·August 27, 2025AI & ML
Performance — How we built the most efficient inference engine for Cloudflare’s network

How we built the most efficient inference engine for Cloudflare’s network

Existing LLM serving engines aren’t efficient enough when deployed across a globally distributed network, so we built our own, in Rust. Infire is an LLM inference engine that employs a range of techniques to maximize resource utilization, allowing us to serve AI models more efficiently and with better performance for Cloudflare workloads.

VKVlad Krasnov, MariVlad Krasnov, Mari·August 27, 2025Performance
Frontend — Research, Review, Rebuild

Research, Review, Rebuild

The Bahmni open-source hospital management system started over nine years ago with a front end using AngularJS and an OpenMRS REST API. We wished to convert this to use a React + TypeScript front end with an HL7 FHIR API. In exploring how to do this modernization we used a structured prompting workflow of Research, Review, and Rebuild - together with Cline, Claude 3.5 Sonnet, Atlassian MCP server,

RRRahul Ramesh·August 27, 2025Frontend
AI & ML — Building your own CLI Coding Agent with Pydantic-AI

Building your own CLI Coding Agent with Pydantic-AI

CLI coding agents are a fundamentally different tool to chatbots or autocomplete tools - they're agents that can read code, run tests, and update a codebase. While commercial tools are impressive, they don't understand the particular context of our environment and the eccentricities of our specific project. Instead we can build our own coding agent by assembling open source tools, using our specif

BOBen O'Mahony·August 27, 2025AI & ML
AI & ML — Securing the AI Revolution: Introducing Cloudflare MCP Server Portals

Securing the AI Revolution: Introducing Cloudflare MCP Server Portals

We’re excited to announce Cloudflare MCP Server Portals are now available in Open Beta. MCP Server Portals are a new capability that enable you to centralize, secure, and observe every MCP connection in your organization. This feature is part of Cloudflare One, our secure access service edge (SASE) platform that helps connect and protect your workspace.

KKennyKenny·August 26, 2025AI & ML