Methods

Every engagement uses some mix of four methods. Each one answers a single question about your system.

Who decides

An escalation ladder names who can halt the system, what triggers each step up, and how fast each tier has to meet. Every decision gets an owner and a path upward.

TierWho decidesTriggerMeets
T1: OperationsOn-call engineering leadError budget over 50% usedDaily during the incident
T2: GovernanceService owner and policy leadMore than 3 P1s in a weekWithin 24 hours
T3: LeadershipExecutive sponsorRegulator inquiry or data lossWithin 48 hours

You get the ladder, a short charter leadership can approve, and a checklist of the evidence a board or regulator will ask for.

What warns you first

Early-warning thresholds turn the signals that come before a failure into alerts with an owner: queue depth, collapsing model confidence, a shift in what people complain about.

SignalSourceYellowRedOwner
API latency p99APM dashboardOver 500ms for 5 minOver 2s for 1 minEngineering lead
Model output dispersionInference logs2× baseline for 1 hour5× or over 1% emptyML engineer
Complaint sentimentSupport queueOver 30% negativeOver 60% or legal keywordsComms lead
Staff overtimeTime trackingOver 12 hours in a weekOver 16 hoursService owner

We tune the thresholds against your incident history so they fire on real trouble, not noise.

Has anyone practiced

A failure drill is a timed, scripted rehearsal with the people who would actually be on the call. Example scenario: the primary on-call doesn’t acknowledge a P1 within 8 minutes. The secondary takes command, the comms lead logs the handoff, and the review records why the page was missed.

Other scenarios we run: a week of model drift with pressure to keep shipping, a third-party model degrading without warning, and a regulation changing mid-quarter. We measure minutes to acknowledgement, whether owner changes were written down, and the overtime and workarounds afterwards. The maintenance readiness snapshot shows where to start.

Can it be undone

A rollback kit is agreed before launch, so nobody drafts it during an incident. It holds a rubric for when to slow, stop, or reverse, the messages to send to customers and regulators, and the steps for handling data with an audit trail.

SignalThresholdActionOwnerClock
Error rate spikeOver 5% for 2 minSlow (canary only)Engineering lead5 min
P1 countMore than 3 in an hourStop the deployIncident commander2 min
User-facing data lossAny confirmed lossRoll backService ownerImmediate
Regulator inquiryAnyRoll backPolicy leadImmediate

The stoppability checklist scores how close you are today. For prices and formats, see engagements.