The state of next-gen image codecs

AVIF draws most of the tech press, but Jon Sneyers argues for JPEG XL — a position consistent with his role as chair of the JPEG XL ad hoc group in the JPEG Committee. In his comparison, JPEG XL wins on every axis except low-fidelity compression, and it adds progressive rendering, which no other next-gen codec offers. WebP — distinct from the upcoming WebP2 — holds a practical advantage in the meantime, with support across all major browsers.

Websites are only part of the picture

Image formats live inside a much broader ecosystem than the web, and that ecosystem largely determines what actually ends up on websites. The chain starts before the browser: what format do your system screenshots produce? What does your digital camera export? What does your design software export? And once images exist, does your site-building software accept them? WordPress, for example, rejects SVG unless you force it — and an AVIF upload fails there too.

Format support on the user side lags as well. A .avif file on a macOS desktop opens as a blank white document with no preview. The image ecosystem as a whole moves slower than the web. Inertia, as Sneyers frames it, is the obstacle:

Let’s just hope that the new codecs will win the battle, which is mostly one that’s against inertia and the “ease” of the status quo. Ultimately, unless JPEG remains a dominant force, regardless of which new codec will prevail, we’ll reap the benefits of stronger compression, higher image fidelity, and color accuracy, which translate to more captivating, faster-loading images.

Outsourcing the format problem

Services such as Cloudinary, where Sneyers’ post is published, offer a way out: upload whatever you have (ideally large and high quality) and the service serves the best format, size and quality for each situation. Tracking formats manually, and staying current over the long term, is too hard to do by hand. And codecs will keep evolving as long as images are displayed on screens — there is no endgame.

Open question: JPEG XR

JPEG 2000 is still around, but what happened to JPEG XR? It was discussed for serving even with <source> not long ago. Was it mostly an IE feature that died with IE?