The takeaway
A before-and-after improvement is not automatically caused by the program.
Three claims that need different support
“Turnover declined” is an observation. “Lower turnover would be worth this amount” is a calculation. “This program caused a reduction worth this amount” is a causal and economic claim. Keep those statements separate in the analysis and the final presentation.
What evaluation guidance says
HM Treasury’s impact-evaluation guidance treats a simple before-and-after comparison without a control as a weak basis for attribution. Randomized or well-designed quasi-experimental approaches can offer stronger evidence, subject to their assumptions and data quality. A comparison group is not automatically a credible counterfactual. [1]
Define the measurement before launch
Write down the eligible population, outcome definition, observation period, implementation date, and comparison strategy. Record concurrent changes that could influence results. Ask a qualified evaluator whether the available design supports the causal question you intend to answer.
Where a credible comparison is not feasible, report the result as monitoring or a scenario. That can still inform a decision. The problem is not imperfect evidence; it is claiming a level of certainty the design cannot support.
Keep the financial arithmetic transparent
For a hypothetical $20,000 initiative with $30,000 of genuinely attributable, non-overlapping benefits, net return is $10,000 and ROI is 50%: net benefit divided by cost. If the $30,000 is only a modeled possibility, label the resulting 50% a scenario, not realized ROI.
Use a consistent time horizon. Include implementation and ongoing costs, and distinguish cash savings from capacity that might be redeployed. Do not imply that an hour freed necessarily reduces payroll expense.
Report a range and a qualification
Show which assumptions drive the estimate and whether the conclusion changes under plausible alternatives. State what remains unmeasured. A disciplined report can say the intervention was implemented successfully and outcomes improved while still withholding a causal return claim.
A useful next step
Create a one-page measurement plan before approval, not after the results arrive. Make the strength of the claim a decision made from the evidence rather than a marketing requirement.
Limitations & evidence boundaries
- The worked numbers are hypothetical and demonstrate arithmetic only.
- A causal estimate requires an appropriate design; this article is not a substitute for evaluation expertise.
Worker outcomes and organizational outcomes must be assessed separately. A proposed framework is not a validated instrument.
Sources
- Quality in Policy Impact Evaluation
Study context & review scope
Design: Impact-evaluation methods guidance
Geography: United Kingdom
Source check: 2026-09-07 · Official HTML guidance, including comparison designs and evaluation types.
- Guidance is not an evaluation of Workforce Nexus or of a particular employer intervention.
Revision history
- : Initial unpublished draft imported from the supplied build brief.
- : Rewritten with traceable research, explicit practical interpretation, and article-specific limitations. Human editorial approval pending.
- : Published following site-owner approval in the project conversation.