Codespaces API Regression Causes Brief Outage
GitHub experienced a single availability incident in October 2021, affecting the Codespaces service for roughly one and a half hours. The root cause was an accidental change to the structure of a core Codespaces API response, introduced during the public launch of the service's API.
The schema alteration broke compatibility for existing API clients that depended on the previous, stable format. As a result, users were unable to start new Codespaces from the Visual Studio Code desktop client. Connections to the web editor and pre-existing desktop sessions remained functional, but degraded: the extension displayed an error message and omitted Codespaces metadata from the Remote Explorer view.
Resolution and Mitigation
The issue was resolved by rolling back the regression. After the rollback, all clients—including those for Codespaces created during the incident—were able to connect successfully.
A contributing factor to the longer duration of the outage was the initial failure of monitoring systems to detect the impact. This lack of detection led to an unrelated, subsequent deployment that delayed the rollback. In response, GitHub is investing in tooling for more rigorous end-to-end testing of the extension's interactions with the API, and is expanding monitoring to more closely reflect the user experience across internal service boundaries.



