Jump to a calculator 618 tools
Quality Systems
Corrective & Preventive Action Effectiveness Tracker
Two defects in 420 pieces proves far less than it reads.
Demonstrated Effectiveness
— %
The reduction the verification sample actually proves at the chosen confidence
Rates, Evidence Required & Payback
- Observed Effectiveness (point estimate)
- — %
- Baseline Nonconformity Rate
- — %
- Verified Nonconformity Rate
- — %
- Upper Confidence Limit on Rate
- — %
- Units Needed to Prove the Target
- — units
- Days Needed at This Inspection Rate
- — days
- Monthly Saving at the Proven Rate
- — /month
- Payback on the Action
- — months
The Wilson score limit assumes independent units. Textile nonconformities are rarely independent - they cluster by lot, operator, machine, shift and supplier delivery - so a verification sample drawn from two lots is narrower on paper than it is in truth, and the demonstrated reduction should be read as optimistic when the sample came from few sources. The baseline is treated as a known constant, which is defensible only while the baseline sample is several times the verification sample; when the two are comparable, use a two-proportion test or a Fisher exact test instead, and expect the defensible reduction to fall further. Never take a baseline from a single bad week: regression to the mean will hand you an improvement no action caused. Below about five expected defects the exact Clopper-Pearson limit is slightly more conservative than Wilson and is the safer choice for a regulatory nonconformity. Units needed to prove the target caps at 1,000,000 and the days figure at 36,500 when the observed rate is at or above the target rate, since no sample size proves the target in that case. The days figure assumes the verification inspection rate continues unchanged, and it is a floor rather than a plan: a window must also span a full rotation of shifts, operators, lots and machines, because sample size alone does not create representativeness. Costs are per unit in any single currency, and the saving is deliberately booked at the proven rate rather than the observed one.
Using this calculator
About the Corrective & Preventive Action Effectiveness Tracker
The formula
This is the expression the tool evaluates. Every term is named underneath, with the unit it must be supplied in.
baselineRate = baselineDefects / baselineUnits verifiedRate = verifyDefects / verifyUnitsBoth are counts of nonconforming units over units inspected. Keep the inspection definition identical either side of the action, because a tightened check or an extra inspector changes the measured rate without changing the process.
upperRate = ( p + z^2 / (2n) + z x sqrt( p (1 - p) / n + z^2 / (4 n^2) ) ) / ( 1 + z^2 / n )The score interval rather than the textbook normal interval, because it stays sensible when the count is small or zero - exactly the region a CAPA verification lives in. With p = 0 it returns a finite limit where the normal approximation returns zero and claims perfection.
demonstratedReduction = ( baselineRate - upperRate ) / baselineRate x 100The observed reduction uses the point estimate and answers the question nobody asked. This one answers the auditor: given only this sample, what improvement can be defended? A negative value means the sample cannot even rule out that the rate got worse.
unitsForProof = z^2 x targetRate x ( 1 - targetRate ) / ( targetRate - verifiedRate )^2The same score bound inverted. It is the honest answer to how much longer the CAPA stays open, and it grows with the square of how close the observed rate sits to the target - which is why a marginal improvement is so expensive to prove.
| Symbol | Stands for | Unit |
|---|---|---|
p | Observed nonconformity rate after the action, as a fraction | - |
n | Units inspected in the verification window | units |
z | One-sided standard normal quantile for the confidence level | - |
p_U | Upper confidence limit on the post-action rate | - |
p_t | Rate that satisfies the closure target | - |
How the result is derived
Step by step, from the values you type to the figure on screen.
- The 10 inputs are read from the form on every keystroke: Units Inspected Before Action, Nonconformities Found Before Action, Units Inspected After Action, Nonconformities Found After Action, Verification Window, Confidence Level (one-sided), Reduction Required for Closure, Monthly Volume Exposed, Cost per Nonconforming Unit and Cost of the Action.
- Each value is checked against the accepted range in the input table below. A value outside its range stops the calculation rather than producing a misleading figure — the results blank out and a message appears.
- The validated values are substituted into the expression above, which resolves Demonstrated Effectiveness together with every supporting figure in one pass — no value is carried over from a previous entry.
- The supporting outputs — Observed Effectiveness (point estimate), Baseline Nonconformity Rate, Verified Nonconformity Rate, Upper Confidence Limit on Rate, Units Needed to Prove the Target, Days Needed at This Inspection Rate, Monthly Saving at the Proven Rate and Payback on the Action — come from the same pass, so they always describe the same case as the headline figure.
- Results are rounded for display only. The full-precision value is used throughout the chain, so reading a rounded intermediate figure back into the tool by hand can shift the last digit.
What each input means
Where to read each value on the floor, the unit it must be in, and the range the tool accepts.
| Input | Unit | Accepted range | Default | What it means |
|---|---|---|---|---|
| Units Inspected Before Action | units | 30 to 5000000 units | 12000 | The period the nonconformity was quantified over |
| Nonconformities Found Before Action | units | 0 to 1000000 units | 288 | |
| Units Inspected After Action | units | 10 to 5000000 units | 420 | |
| Nonconformities Found After Action | units | 0 to 1000000 units | 2 | |
| Verification Window | days | 1 to 730 days | 45 | Elapsed days the verification sample was drawn over |
| Confidence Level (one-sided) | — | 90 percent - internal review · 95 percent - normal audit evidence · 99 percent - safety or regulatory nonconformity | 1.6449 | Sets the z multiplier on the upper limit |
| Reduction Required for Closure | % | 5 to 99 % | 50 | |
| Monthly Volume Exposed | units/month | 100 to 5000000 units/month | 26000 | |
| Cost per Nonconforming Unit | /unit | 0.01 to 5000 /unit | 6.4 | Rework, downgrade and handling, blended |
| Cost of the Action | — | 0 to 5000000 | 9500 |
What the tool returns
The headline figure and every supporting value it is built from.
| Output | Unit | What it tells you |
|---|---|---|
| Demonstrated Effectiveness (headline result) | % | The reduction the verification sample actually proves at the chosen confidence |
| Observed Effectiveness (point estimate) | % | |
| Baseline Nonconformity Rate | % | |
| Verified Nonconformity Rate | % | |
| Upper Confidence Limit on Rate | % | |
| Units Needed to Prove the Target | units | |
| Days Needed at This Inspection Rate | days | |
| Monthly Saving at the Proven Rate | /month | |
| Payback on the Action | months |
Worked example
Given
- 0
- Baseline: 288 nonconformities in 12,000 units inspected
- 1
- Verification: 2 nonconformities in 420 units over 45 days
- 2
- Confidence 95 percent one-sided (z = 1.6449)
- 3
- Closure needs a 50 percent reduction
- 4
- 26,000 units/month exposed, 6.40 per nonconforming unit, action cost 9,500
Substituting
baselineRate = 288 / 12000 = 2.4%; verifiedRate = 2 / 420 = 0.4762%Observed reduction = ( 2.4 - 0.4762 ) / 2.4 x 100 = 80.1587%Wilson upper limit at z = 1.6449, n = 420, p = 0.004762 gives upperRate = 1.4287%Demonstrated reduction = ( 2.4 - 1.4287 ) / 2.4 x 100 = 40.472%, short of the 50% bartargetRate = 2.4 x ( 1 - 0.50 ) = 1.2%; unitsForProof = 1.6449^2 x 0.012 x 0.988 / ( 0.012 - 0.004762 )^2 = 613 unitsdaysForProof = 613 / ( 420 / 45 ) = 65.6786 daysmonthlySaving = ( 2.4 - 1.4287 ) / 100 x 26000 x 6.40 = 1616.2905; payback = 9500 / 1616.2905 = 5.8777 monthsAnswer
- 0
- Demonstrated effectiveness 40.472%
- 1
- Observed effectiveness 80.1587%
- 2
- Baseline rate 2.4%, verified rate 0.4762%
- 3
- Upper confidence limit on the rate 1.4287%
- 4
- Units needed to prove the target 613, i.e. 65.6786 days
- 5
- Monthly saving 1616.2905, payback 5.8777 months
The closure meeting sees an 80% improvement and signs. The sample defends 40.472%, which fails the 50% rule the same meeting wrote. Nothing is wrong with the action - the window is simply too short, and 193 more inspected units, about three more weeks at the current rate, would settle it. The payback moves the same way: 5.8777 months on the proven rate against about 3.0 months on the observed one.
How to use it
- Work through the input groups in order — Baseline Before Action, Verification After Action and Closure Test & Cost. The defaults are a realistic case, so you can change one value at a time and watch what moves.
- There is no calculate button. Every figure recalculates as you type or drag, which is what makes this usable for a what-if sweep rather than a single answer.
- Read Demonstrated Effectiveness in the dark results panel — that is the headline figure, expressed in %.
- Check the supporting rows underneath (Observed Effectiveness (point estimate), Baseline Nonconformity Rate, Verified Nonconformity Rate, Upper Confidence Limit on Rate, Units Needed to Prove the Target, Days Needed at This Inspection Rate, Monthly Saving at the Proven Rate and Payback on the Action) before acting on the headline — they are where an implausible input usually shows itself first.
- Reset to defaults returns every field to the reference case, which is the quickest way to check whether a surprising result came from the tool or from an input you had changed earlier.
Where this is used
- Process planning — establishing Demonstrated Effectiveness before a trial is booked, so machine time and material in Quality Systems, Traceability, Utilities & Factory Decisions are committed against a calculated figure rather than an estimate.
- Costing and quotation — Demonstrated Effectiveness is an input to the cost sheet, and quoting from a worked number rather than a remembered one is what keeps a margin intact.
- Troubleshooting — when the floor result drifts from plan, entering the measured values (starting with Units Inspected Before Action) shows how much of the gap in Demonstrated Effectiveness each variable explains.
- Teaching and study — the accepted ranges bracket normal Quality Systems, Traceability, Utilities & Factory Decisions practice, so moving one variable at a time shows the shape of the relationship rather than a single answer.
Reading the result
Typical bands and what each one is telling you.
| Value | What it indicates |
|---|---|
| Demonstrated at or above the target | Closure is supportable: even the upper limit of the post-action rate clears the bar. |
| Demonstrated between 0 and the target | The direction is right and the sample is too small. Keep the CAPA open and run the window out to the days figure. |
| Demonstrated below 0 | The sample cannot rule out that the rate is unchanged or worse. This is the state most prematurely closed CAPAs are in. |
| Units needed at the 1,000,000 cap | The observed rate is already at or above the target rate, so no sample size proves the target. The action, not the evidence, is the problem. |
| Payback beyond 12 months | At the proven rate the action costs more than the nonconformities it removes in a year. Worth revisiting scope before closing. |
Assumptions and limits
- The Wilson score limit assumes independent units. Textile nonconformities are rarely independent - they cluster by lot, operator, machine, shift and supplier delivery - so a verification sample drawn from two lots is narrower on paper than it is in truth, and the demonstrated reduction should be read as optimistic when the sample came from few sources. The baseline is treated as a known constant, which is defensible only while the baseline sample is several times the verification sample; when the two are comparable, use a two-proportion test or a Fisher exact test instead, and expect the defensible reduction to fall further. Never take a baseline from a single bad week: regression to the mean will hand you an improvement no action caused. Below about five expected defects the exact Clopper-Pearson limit is slightly more conservative than Wilson and is the safer choice for a regulatory nonconformity. Units needed to prove the target caps at 1,000,000 and the days figure at 36,500 when the observed rate is at or above the target rate, since no sample size proves the target in that case. The days figure assumes the verification inspection rate continues unchanged, and it is a floor rather than a plan: a window must also span a full rotation of shifts, operators, lots and machines, because sample size alone does not create representativeness. Costs are per unit in any single currency, and the saving is deliberately booked at the proven rate rather than the observed one.
- Every input is bounded to the range normal practice occupies (Units Inspected Before Action 30 to 5000000 units, Nonconformities Found Before Action 0 to 1000000 units and Units Inspected After Action 10 to 5000000 units, and so on for the rest). Those bounds are guard rails against typing errors, not a claim that the formula fails one unit outside them.
- The calculation is deterministic: the same inputs always give the same result. It carries no allowance for machine condition, operator skill, ambient conditions or lot-to-lot material variation unless an input above explicitly represents one.
- Nothing is sent anywhere. The maths runs in your browser, so the numbers you type never leave the page.
Standards and further reading
- ISO 9001:2015 clause 10.2.1 - Nonconformity and corrective action, which requires the organisation to review the effectiveness of any corrective action taken, and clause 10.2.2 for the documented information that has to be retained.
- ISO 11453 - Statistical interpretation of data: tests and confidence intervals relating to proportions, the basis for treating a verification count as an interval rather than a value.
- ISO 2859-1 - Sampling procedures for inspection by attributes, Part 1, which normally generates the inspected counts entered here.
- ISO 19011:2018 - Guidelines for auditing management systems, whose follow-up provisions decide what an auditor will accept as closure evidence.
Questions people ask
Why is the demonstrated reduction so much lower than the one we observed?
Because the observed rate is one draw from a random process, not a property of the process. Two nonconformities in 420 units is 0.48%, but a process running at three times that rate would still produce two or fewer defects in 420 units about one time in sixteen, which is precisely why the limit sits where it does. The one-sided 95% Wilson limit on 2 in 420 is 1.43%, so the defensible claim is that the rate is below 1.43% - against a 2.40% baseline that is a 40% reduction, not 80%. The gap narrows with the square root of the sample size rather than the sample size, which is why doubling the window helps far less than people expect and why marginal improvements are so expensive to prove.
We have had zero recurrences since the action. Is that not proof enough?
Zero is the weakest evidence there is, because it is exactly what a rare event looks like when you have not watched long enough. The rule of three says the 95% one-sided upper limit after zero events in n trials is about 3/n: 300 units with no defects only proves the rate is below roughly 1%. Put a 1.20% baseline, 300 units and zero defects into this tool and the demonstrated effectiveness comes back at 25.5%, not 100%, because the upper limit sits at 0.89%. The question an auditor asks is the same one in reverse - how many units would you have had to inspect before you expected to see even one? If the answer is more than you inspected, the absence of recurrence carries no information.
Our rate dropped but we only added a 100 percent screening check. Does this see the difference?
No, and no statistical test can. A containment action - sorting, screening, an added inspection station - lowers the rate that reaches the next process without touching the cause, and it produces a perfectly respectable demonstrated reduction here. ISO 9001 clause 10.2.1 deliberately separates the two: react to the nonconformity and deal with its consequences, then evaluate the need for action to eliminate the causes so that it does not recur. Only the second is corrective action. The practical test is to remove the screen for a defined and monitored run and see whether the rate returns; if it does, what you have is containment with a closure date, and the cost of that screen belongs in the running cost of the product rather than in the payback figure above.
How do you verify a preventive action, which has no baseline defect rate?
ISO 9001:2015 removed the separate preventive action clause that ISO 9001:2008 carried at 8.5.3 and folded the intent into clause 6.1, actions to address risks and opportunities. That changes what you can measure: a preventive action has no nonconformity history, so there is nothing to put in the baseline field. The workable substitute is to verify the driver rather than the failure - the process capability index, the incoming lot variability, the calibration drift, the temperature excursion count - and run the same arithmetic on that leading indicator with its own before and after counts. If no such indicator exists, be honest that the action is unverified rather than effective, and record it that way; an unverifiable preventive action is still worth taking, but calling it proven is what makes the next audit finding a systemic one.