Systems | Development | Analytics | API | Testing

The pitch for AI coding was speed. Claude Code, Copilot, Cursor, whatever you’re running, they all generate business logic faster than you can review it. That part is real. But look at what happens after the code gets written and the numbers get ugly. CircleCI’s 2026 State of Software Delivery Report found AI drove a 59% increase in average throughput.

Shipping fast is great until the wrong thing ships fast. A CI/CD pipeline can move code from commit to production in minutes, but speed alone does not tell you whether a login still works, a checkout flow still completes, or a critical form still submits. That is the job of CI/CD testing. The best pipelines do more than pass builds. They catch small problems before they become customer-facing ones, using the right mix of unit, integration, API, browser, smoke, and post-deployment tests.

We shipped v2 of a small products API on a Thursday. Green CI. Green replay. The new search endpoint worked. I went home feeling competent. Friday morning I ran the same traffic against both builds with proxymock and compared the SQL. v2 had added 80 queries on the same HTTP script. A per-product audit COUNT was firing inside the list handler. A startup migration had run ALTER TABLE and CREATE TABLE audit_log. Total DB time was up 70 ms on a demo that should have been boring.

A customer emailed on a Tuesday: checkout hung for ten seconds. I opened our tracing tool, punched in the time window, and got nothing. The trace was sampled out. We keep 1% of traces, like most shops with real traffic do. The one request that actually mattered was in the 99% we threw away. I spent twenty minutes admiring our observability stack before admitting it couldn’t answer a first-grader’s question: what happened to this person? Here’s what I know now.

Having maintained a CodePush fork for 18 months and served billions of updates, we decided it was time for an overhaul. We’re big fans of CodePush, and it was a great benefit to the React Native community. But, it was written in 2015 and had some weaknesses. The biggest of these was architectural, with limitations in how update checks and release metadata could scale. The result, Codemagic Patch, is now public and available to self-host.