Beyond Quality

An open-source community for deeper enquiry.

Podcast

Implementing rational QA improvements: a companion guide for engineers

Vitaly Sharovatov Updated June 22, 2026 Discussion

Implementing rational QA improvements: a companion guide for engineers

This guide is a companion to the economics of testing research and the social resistance to rational change analysis. The economics of testing tells you what to propose; the resistance analysis tells you why rational proposals get rejected; this guide tells you how to land the proposal.

Audience: engineers who have identified a rational, justified improvement to their organisation’s testing strategy and want to implement it.

Assumption: the proposed change is instrumentally rational under the economics-of-testing model (i.e., it improves expected total cost of quality over an appropriate horizon). This guide does not address how to design the right testing strategy; it addresses how to get a good strategy adopted.

Why rational proposals fail for rational reasons

A common experience: an engineer analyses the testing portfolio, identifies a clear improvement (e.g., shift investment from redundant end-to-end checks to earlier prevention and targeted appraisal), presents a well-reasoned case, and gets rejected. The engineer perceives the rejection as irrational. It is not.

The manager’s rejection is often locally rational given their constraints:

These are not personal failings. They are predictable consequences of how organisations structure incentives, accountability, and decision-making. The CFIR-based resistance analysis maps these forces systematically.

The implication: the technical quality of the proposal is necessary but not sufficient. Engineers must also address the social, political, and structural conditions that determine whether a rational proposal gets adopted.

Strategy 1: Build a coalition and quantify in the organisation’s own language

The single most effective move is to stop being the sole messenger. Before proposing the change, build a cross-functional coalition that makes the business case visible in terms the organisation already cares about.

Why this works (mapped to resistance factors):

How to do it:

  1. Partner with Customer Support to identify which escaped defects cost the most in ticket handling, escalations, and resolution time. Support teams often have this data already but no one asks them for it in a quality context.

  2. Partner with Sales / Account Management to identify which bugs, outages, or quality issues put renewals and expansions at risk. Sales teams experience quality failures as deal risk and can often attach revenue figures.

  3. Partner with Finance to quantify SLA credits, refunds, contractual penalties, and incident response costs. Finance can provide the monetary framing that makes the case legible to executive decision-makers.

  4. Partner with Engineering to quantify incident response effort, hotfix cycles, rework hours, and delivery drag caused by quality issues.

  5. Aggregate into Cost of Quality language: the data from steps 1-4 gives you external failure costs (production incidents, support load, revenue impact, penalties) and internal failure costs (rework, retesting, debugging, delayed releases). This is the CoQ framework from the economics of testing model, but populated with your organisation’s actual numbers.

The result: a business case grounded in cross-functional data, delivered by a coalition rather than a single engineer. This is structurally different from presenting a testing framework and asking the manager to trust it.

Caveat: read the culture first. Cross-functional data-gathering requires navigating organisational norms. In some cultures, reaching out to Sales or Finance as an engineer is welcomed; in others, it may be perceived as going around your manager or overstepping your role. Frame the data-gathering as understanding the organisation’s cost structure (“I want to understand how quality issues affect us across departments”) rather than building a case against current practices.

Strategy 2: Align the proposal with the manager’s incentives

The resistance analysis identifies incentive misalignment (Kerr’s “Rewarding A while hoping for B”) as a key blocker. The most direct counter is to reframe the proposal in terms of the manager’s existing goals.

How to do it:

  1. Identify the manager’s OKRs/KPIs. What are they measured on this quarter and this year? Common metrics include delivery velocity, feature throughput, team capacity, incident counts, or customer satisfaction scores.

  2. Map the proposal to those metrics. Show how the change helps the manager hit their existing targets, not just how it improves quality in the abstract.

    Examples:

    • Manager is measured on delivery velocity: show that rework and hotfixes currently consume X% of sprint capacity. Prevention investment removes drag on the metric they are already measured on. The proposal is not “slow down to improve quality”; it is “remove the thing that is already slowing you down”.
    • Manager is measured on incident count or availability SLOs: show that the proposed testing changes target the specific failure modes that cause incidents. The proposal directly reduces the metric they are accountable for.
    • Manager is measured on customer satisfaction / NPS: connect the quality-in-use data (from the economics of testing Step 2) to the satisfaction signals the manager is already tracking.
  3. Address the headcount concern explicitly. If the manager fears that a successful improvement will lead to headcount reduction, address this directly. Reframe: freed-up capacity is reallocated to higher-value work (exploratory testing, prevention, new capabilities), not eliminated. If you cannot make this case honestly, acknowledge the tension rather than hiding it.

Why this works: the proposal stops being a request to take a risk and becomes an offer to hit existing targets more effectively. The manager’s rational self-interest is aligned with the change rather than against it.

Strategy 3: Time the proposal to the budgeting and planning cycle

The resistance analysis identifies budget rigidity and structural inertia as blockers. Timing the proposal to when the organisation is structurally ready to hear it is a low-effort, high-impact move.

How to do it:

  1. Learn when planning happens. Most organisations plan budgets and headcount on an annual cycle, often in Q3 for the following year. Some have quarterly planning or rolling budgets. Understand your organisation’s rhythm.

  2. Plant the seed before the planning window. If annual planning happens in September, start the coalition-building and data-gathering in June-July. By the time planning starts, the data is ready and the allies are already engaged.

  3. Propose during the planning window, not after it. A proposal that arrives after budgets are locked competes against committed plans. A proposal that arrives during planning is one option among many, evaluated on its merits.

  4. Use natural trigger events. Major incidents, architecture changes, regulatory shifts, or leadership changes create windows where the organisation is temporarily more receptive to change. The CFIR framework calls these event-driven review triggers. Be ready with data when these windows open, but avoid the perception of exploiting a crisis.

Why this works: the same proposal that feels like a disruptive mid-cycle reallocation in May can feel like a sensible planning input in September. The content is identical; the structural context determines reception.

Strategy 4: Size the ask to the change

The economics of testing model supports changes ranging from “add a linter to CI” to “restructure the entire testing portfolio”. The coalition-and-data approach described above is heavy machinery. Match the change strategy to the size of the change.

Small, reversible changes (adding a tool, adjusting a CI gate, changing a test practice within one team):

Medium changes (reallocating effort across testing types, introducing a new testing level, changing coverage targets across teams):

Large changes (restructuring the testing portfolio, changing the balance between prevention and appraisal, rebudgeting across departments):

Why this matters: over-engineering the change process for a small improvement creates unnecessary friction and may signal to the manager that the engineer does not understand organisational proportionality. Under-engineering it for a large change leads to the “everyone agrees in principle” failure mode where consensus never translates into action.

Strategy 5: Start small, show results, expand

When the full proposal faces resistance, a bounded pilot reduces the manager’s perceived risk while creating internal evidence.

How to do it:

  1. Propose a pilot on one team or one product area. Choose a scope where the risk is visible (e.g., high escaped-defect rate, frequent incidents) and the change is measurable.

  2. Define success criteria in advance. Use the metrics from Step 4 of the economics of testing: defect containment ratio, escaped defect rate, rework hours, incident frequency, or CoQ shift. Agree on these with the manager before starting.

  3. Run the pilot with a defined time horizon. Long enough to produce meaningful data (typically one to two quarters), short enough that the manager has an exit ramp if it does not work.

  4. Report results in the manager’s language. Not “we achieved 85% branch coverage”; instead “rework hours dropped by X%, incident rate dropped by Y%, and the team shipped Z% more features in the same period”.

  5. Use pilot results as internal evidence for expansion. Internal success cases are structurally similar to the “prior success cases” that consultants are asked to provide, but with the advantage of being from the organisation’s own context. They are harder to dismiss as non-transferable.

Why this works: the pilot addresses multiple resistance factors simultaneously:

When it still fails

Even with allies, aligned incentives, good timing, a right-sized ask, and pilot evidence, some organisations will not change. The resistance may be structural (deeply misaligned incentives, leadership that does not value quality), cultural (a climate where slowing down is always punished), or political (decision-makers who have committed to the status quo and cannot reverse without losing face).

This is worth acknowledging honestly rather than pretending that better technique always wins.

Options when the organisation will not move:

Summary

Strategy Resistance factors addressed When to use
Build a coalition with data Source credibility, evidence strength, coalition/process, manager’s blame exposure Medium to large changes
Align with manager’s incentives Incentive misalignment, perceived relative advantage Always
Time to budgeting cycle Budget rigidity, structural inertia, organisational readiness Changes that require budget reallocation
Size the ask Proportionality, perceived complexity and cost Always
Start small with a pilot Perceived risk, evidence strength, source credibility When full proposal faces resistance

The common thread: shift from presenting a rational argument to creating the structural conditions under which the argument can be heard. The economics of testing provides the content; this guide provides the delivery mechanism.

References