← All examples
Product rescue

A product nobody dared touch, running itself in two weeks

A live AI video prototype, demoed and sold to an enterprise customer who was already onboarded and using it. Keeping it running took constant manual work: no safety checks, security gaps, and every update released by hand from one person’s laptop. The fix was a method, not a rebuild.

Client
Broadcast media company
Timeline
14 days
Role
Lead engineer
Downtime
None
01

A good engine with no locks and no brakes

The heart of the product was well built. Everything around it that keeps a business safe was missing, and people were doing that work by hand every day.

WhatBeforeAfter
Keeping it aliveConstant manual workRuns itself
Safety checksNone540, on every change
SecurityParts open to anyoneEvery door checked and locked
Releasing updatesBy hand, one laptopAutomatic, with undo
Place to test safelyNoneA separate copy
Early warningsNone13 automatic alerts
New customer setupAn engineer’s choreHappens on its own
Knowing what is liveNobody could sayProvable at any moment
Before and after
02

How we did it

  1. 01

    Understand first

    Before changing anything, 340 automatic checks recorded how the product behaved.

  2. 02

    Lock the doors

    Security gaps closed in two careful steps, with no outage for customers.

  3. 03

    Take control

    Alerts for the first time, releases four times faster, setup that runs itself.

  4. 04

    Run it the new way

    Every issue after that was measured first, then fixed through the new process.

03

One moment from the work

Measured, then fixed

“The dashboard is empty for everyone.”

It sounded like an outage. The records showed 43 failed requests from four computers over two days. The cause was a hidden size limit, not a broken product.

Reported
Everyone
Measured
4 computers · 43 requests
Result
Fixed, with an alert
04

What any team can take from this

  • Write it down first

    Record how something works before you change it.

  • Let the system check security

    A rule the system enforces beats one people must remember.

  • Count before you fix

    The loudest report is rarely the real size of the problem.