The Quality Flywheel
The Quality Flywheel / Chapter 05 of 05

What the Next Failure Inherits

A loop becomes a flywheel when its useful work survives the turn.

Part of The Quality Flywheel ↗
Chapters in this collection 05 / 05

Consider the next website slowdown. This time a promotion has brought a surge of visitors. Atlas checks the request volume, the work per request, and the available capacity. It does not recommend rolling back an unrelated deployment merely because the last outage involved a bad change.

That is the lesson worth keeping: distinguish the causes before choosing the remedy. Memorizing the previous fix would have made the next investigation worse.

A quality flywheel carries those useful distinctions forward. A loop can keep a team busy while it rediscovers the same facts. A flywheel changes what the next investigation starts with.

Experience becomes useful when the next cycle can reuse it A clockwise loop connects observe an incident, explain the failure, test a change, and ship and monitor. At its center, retained cases, checks, and evidence carry learning into the next cycle. Running the loop again is not enough: keeping those assets makes later diagnosis and testing cheaper. Observe anincident Explainthe failure Test achange Ship andmonitor KEEP Cases Checks Evidence
The useful output of a cycle is more than a fix. A saved case, a reliable check, and a record of what worked make the next cycle easier.

Retain the distinction, not the remedy

The useful memory of the earlier outage takes several forms. A saved case preserves the evidence. A better monitoring summary makes missing information visible. Contrasting tests distinguish increased traffic from expensive processing. A comparison between versions explains why the team kept a change to Atlas.

These assets do different jobs. An incident record preserves what happened. A regression test asks whether the mistake has returned. A procedure tells Atlas what to inspect. A release record tells the next engineer which claim the evidence supported.

What Atlas should carry forward

Before treating high CPU as a shortage of capacity, distinguish more requests from more work per request.

Inspect traffic, recent changes, and where processing time is spent. If the available evidence cannot separate the explanations, say what is missing and investigate before recommending a consequential action.

The rule is useful because it directs attention. It does not settle every incident. A traffic surge and an inefficient new operation can occur together; a database delay can create retries that increase traffic. The procedure should help Atlas ask a better next question while remaining open to evidence.

Memory needs an admission policy

Reflexion explored using verbal feedback as memory for later attempts without updating model weights. Agentic Context Engineering develops the idea into an evolving context playbook. These approaches make retained experience part of the system being improved.

But saving an explanation does not make it true. “High CPU means add servers” and “always roll back the latest change” can each succeed on selected cases. Neither is a dependable rule without the conditions that make it apply.

A lesson earns a place when it works beyond the episode that produced it. Keep the supporting cases and the counterexample. Record its scope. When a new incident contradicts it, revise the rule or narrow the claim. Otherwise the playbook becomes advice no one can justify.

Compounding has a maintenance bill

More tests are not automatically more knowledge. Twenty near-identical outages may add runtime without checking another distinction. A saved result can also become misleading after the service architecture changes. A once-useful recovery procedure may no longer be appropriate.

Retire duplicates. Keep the relevant environment and assumptions with each test. Revisit the standards when the assistant's responsibilities change. Preserve useful history, but separate what the system currently relies on from what it once believed.

The flywheel earns its name only if the retained work helps enough to repay this maintenance. The next failure should take less effort to reproduce or lead to a better experiment. An archive that grows while investigation remains equally difficult is accumulating records without gaining much momentum.

Improve the machinery of improvement

The deeper opportunity is to make the team better at learning. A failure can improve the assistant. It can also reveal missing monitoring data, expose a blind spot in the evaluator, or suggest a more revealing test. Those changes increase the value of later work.

Current methods increasingly automate proposal, evaluation, and memory. The unresolved task is keeping these parts honest with one another: a powerful search should not exploit a weak judge, and a persuasive memory should not become evidence for itself.

The real outage that opened this collection exposes the underlying responsibility. A test can pass while an important requirement remains unexamined. An improvement process earns trust by discovering that missing question, making it testable, and preserving it for the next change.

The next failure deserves to meet a system that kept the lesson—and the means to challenge it.

Start typing to search the writing.