ShareCraft
Practice listing thumbnail image for Effective Outcomes Measures & Systems by Social Finance UK, any issue practice
Free to license
Social Finance UK

Effective Outcomes Measures & Systems

A practical, step-by-step method for selecting, designing and measuring outcome metrics that stand up to scrutiny, from Social Impact Bonds through to everyday charity impact reporting.

Back
  • Tool or method
  • Any issue

About this practice

What this practice gives you

Effective Outcomes Measures & Systems combines two proven UK approaches into one practical toolkit: Social Finance's technical guide for designing outcome metrics for Social Impact Bonds and outcomes-based contracts, and NPC's Four Pillar Approach for building an organisation-wide impact measurement framework.

Who it's for

Commissioners exploring outcomes-based commissioning or a Social Impact Bond, and charity or social enterprise leaders under pressure from funders to demonstrate impact but unsure where to start.

What you get

  • A five-question funnel for selecting outcome metrics, and a fuller six-question decision process for outcomes-based contracts
  • A structured comparison of attribution models (randomised control trials, matched control, historical baseline, tariff and before/after studies) so you can choose the right level of rigour for your budget and stakes
  • NPC's four-step sequence for building a measurement framework: map your theory of change, prioritise what you measure, choose your level of evidence, select your sources and tools
  • Real worked examples, including the Peterborough and Essex Social Impact Bonds and the DWP Innovation Fund outcomes tariff

This resource and all Field Guide content and Resource Content is developed by www.sharecraft.org from client content. This content has been produced for learning and information purposes only and should not be relied on as individual advice. Refer to original source material or references for more detail.

Who it’s for

Commissioners exploring outcomes-based contracts, and charity, social enterprise or funder staff needing to build a credible measurement framework.

Target population

Public sector commissioners considering outcomes-based commissioning or a Social Impact Bond, and charity, social enterprise and funder staff (particularly impact, evaluation or fundraising leads) who need to build or improve a measurement framework. Indirectly, the practice benefits the service users and communities whose programmes are better targeted and better evidenced as a result.

How it’s delivered

  • Structured Training
Outcomes

Short term outcomes

  • A clear, shared theory of change agreed across the organisation or contracting parties
  • A prioritised, well-defined shortlist of outcomes instead of an unwieldy list
  • An evidence plan matched to the resources and stakes involved

Long term outcomes

  • Credible, defensible evidence of impact that withstands funder, investor or commissioner scrutiny
  • Funding, investment and commissioning decisions made on genuine evidence rather than guesswork
  • Organisations that use their own data to learn and improve services, not just to report on them
Evidence

Direct evidence

The methodology in this practice has an independently assessed track record. The Peterborough Prison Social Impact Bond, the world's first SIB, achieved an 8.4% reduction in reconviction events for its first cohort of 1,000 prisoners relative to a matched control group, independently assessed by Professor Darrick Joliffe and colleagues from Qinetiq and the University of Leicester for the Ministry of Justice. The Essex Edge of Care SIB, the first UK SIB with a local authority commissioner, applied the same attribution and outcome design principles using a historical comparison group.

Internal evidence

NPC had completed consulting projects for 16 organisations using its Four Pillar Approach as of April 2014; 9 of these, including Mind, Business in the Community and Send a Cow, used some or all of the framework to assess or report impact. Across roughly 100 practitioners taken through the approach in public workshops, 83% said they would use what they learned and 59% said they would make changes in their charity as a result.

Sources: Social Finance (2015) Technical Guide: Designing Outcome Metrics and Measurement Systems, www.socialfinance.org.uk; Kazimirski, A. and Pritchard, D. (2014) Building Your Measurement Framework: NPC's Four Pillar Approach, New Philanthropy Capital.

Implementation considerations
  • Assign a single named lead for measurement; NPC's experience shows organisations without one struggle most with this approach
  • Budget realistically for monitoring and evaluation; charities typically spend only around 3% of budget on this against a sometimes-recommended 10%
  • Start with your theory of change before choosing any metric or tool, even under funder or contract deadline pressure
  • Use existing validated tools and data sources before building new ones
  • Match your level of evidence (before/after, historical baseline, matched control, tariff, or RCT) to the size of the decision and the resources actually available
  • Build in a perverse incentive check for any outcome that will trigger payment or funding decisions

Share what works.

ShareCraft is where organisations in the social sector find, license and share practices that work. Join free to open this Practice Guide.

Sign up to get this free practiceLog in