Our site places cookies on your device to give you the best experience. You can change your cookie settings at any time. Our Privacy Notice has more information on how to do this. I’m happy, please close this message

CAF: Charities Aid Foundation CAF: Charities Aid Foundation Skip to main content
Donate to a charity
Register
Log inClose CAF account drop-down menuLog in to your CAF account
CAF accountManage your:
CAF American Donor Fund
CAF Charity Account
CAF Charitable Trust
CAF Company Account
CAF Charity Dashboard
CAF Donate
CAF Give As You Earn

CAF BankManage your bank account
InvestmentsManage your CAF Investment Account
Search

Search

Search box
open menu close menu Menu Close
Donate to a charity
  • ◄ I'm an individual ►
  • ◄ I'm a company ►
  • ◄ I'm a charity ►
  • ◄ International giving ►
  • ◄ CAF Bank ►
  • ◄ About us ►
  • Careers
  • For charities
  • For individuals
  • For philanthropists
  • For companies
 
  • ◄ Giving to charity > ►
  • ◄ Private Client Philanthropy > ►
  • ◄ Know more about giving > ►
  • ◄ Help and support > ►
  • ◄ Donate now > ►
  • ◄ Leave a lasting legacy
  • ◄ Grantmaking through us
  • ◄ Services for professional advisers
 
  • ◄ Employee giving > ►
  • ◄ Employee engagement > ►
  • ◄ Corporate giving > ►
  • ◄ Corporate and workplace fundraising
  • ◄ Impact advisory
  • ◄ Corporate grantmaking
  • ◄ Resource centre > ►
 
  • ◄ Cost-of-living resources
  • ◄ Everyday banking > ►
  • ◄ Savings > ►
  • ◄ Loans and social investment > ►
  • ◄ Investments > ►
  • ◄ Fundraising > ►
  • ◄ Your donations > ►
  • ◄ Grantmaking > ►
  • ◄ Strategic consultancy > ►
  • ◄ Legacies > ►
  • ◄ Trustees and charity governance
 
  • ◄ Philanthropy Week
  • ◄ Powering world giving
  • ◄ CAF Network
  • ◄ Memberships
  • ◄ Give anywhere safely
  • ◄ Give internationally
  • ◄ Emergency response
  • ◄ Our reach and impact
 
  • ◄ Everyday banking > ►
  • ◄ Loans > ►
  • ◄ Savings > ►
  • ◄ Help and support > ►
  • ◄ About CAF Bank > ►
  • ◄ Security centre > ►
 
  • ◄ Governance > ►
  • ◄ Research and Commentary > ►
  • ◄ Press office > ►
  • Sustainability
 
  • ◄ Connecting you to charities
  • ◄ Open a giving account
  • ◄ Donate overseas
  • ◄ Payroll giving
  • ◄ Leave a lasting legacy
  • ◄ Manage your giving through us
  • ◄ CAF Charitable Trust
  • ◄ Paying Tax in the UK and US?
  • ◄ Become a social investor
  • ◄ Get expert consultancy
  • ◄ Meet the Team
  • ◄ Our tips, guides and information
  • ◄ Gift Aid
  • ◄ Tax efficient giving
  • ◄ Donating
  • ◄ CAF Charity Account
  • ◄ CAF Charitable Trust
  • ◄ Payroll giving
  • ◄ Expert consultancy
  • ◄ Grantmaking
  • ◄ Find a UK charity
  • ◄ CAF Give As You Earn
  • ◄ Grow your Payroll Giving scheme
  • ◄ Matching your employee donations
  • ◄ Get your Payroll Giving Quality Mark
  • ◄ Start engaging employees with charitable giving
  • ◄ Find out more about Payroll Giving
  • ◄ Payroll Giving resource hub
  • ◄ CAF Company Account
  • ◄ Set up a corporate foundation
  • ◄ Manage your corporate grantmaking
  • ◄ Corporate giving insight
  • ◄ Corporate giving case studies
  • ◄ Meet the Team
  • ◄ Get in touch
  • ◄ Everyday charity banking
  • ◄ Online banking
  • ◄ CAF Bank Business card
  • ◄ Taking card payments
  • ◄ Bacs bureau service
  • ◄ Borrowing options
  • ◄ Secured loans with CAF Bank
  • ◄ Social investment with CAF Venturesome
  • ◄ Savings accounts
  • ◄ Instant access savings account
  • ◄ 60 Day Notice Account
  • ◄ 90 Day Notice Account
  • ◄ 12 Month Fixed Rate Saver
  • ◄ 1 Year Fixed Term Account
  • ◄ CAF Charity Deposit Platform
  • ◄ Investment products
  • ◄ Investment Knowledge Centre
  • ◄ Getting started
  • ◄ Fundraising tips and advice
  • ◄ CAF Donate
  • ◄ CAF Charity Dashboard
  • ◄ How to redeem CAF Charity Vouchers
  • ◄ CAF Donate Help
  • ◄ CAF Charity Dashboard
  • ◄ CAF Charity Dashboard Reporting
  • ◄ Sign up
  • ◄ CAF Charity Dashboard Help
  • ◄ Grantmaking with CAF
  • ◄ Getting a grant
  • ◄ Contact us
  • ◄ Supporting charity development and resilience
  • ◄ Meet the Team
  • ◄ Contact us
  • ◄ Legacies and your charity
  • ◄ Contact us
  • ◄ Contact us
  • ◄ FAQs
  • ◄ Tools and guides
  • ◄ Current account
  • ◄ Online banking
  • ◄ CAF Bank Business card
  • ◄ Taking card payments
  • ◄ Bacs bureau service
  • ◄ Interface for Third Party Providers
  • ◄ Secured loans
  • ◄ Loans for social housing projects
  • ◄ Social purpose development finance
  • ◄ Charity finance guides
  • ◄ Charity finance case studies
  • ◄ Intermediaries - Working with us
  • ◄ Instant access savings account
  • ◄ CAF savings options
  • ◄ We're here to help
  • ◄ Security centre
  • ◄ Protecting your money
  • ◄ Making a complaint
  • ◄ About us
  • ◄ CAF Bank Board of directors
  • ◄ CAF Bank Executives
  • ◄ Meet the team
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ CAF Bank Pillar 3 disclosure (.pdf opens in new window)
  • ◄ CAF Bank Board Directors
  • ◄ CAF Bank Executives
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ CAF Bank Pillar 3 disclosure (.pdf opens in new window)
  • ◄ Complaints procedure
  • ◄ Our trustees
  • ◄ Our executive
  • ◄ Committees
  • ◄ Annual reports
  • ◄ Our Standards and Conduct Policy
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ Complaints procedure
  • ◄ Giving Tuesday
  • ◄ Champion for charities
  • ◄ Groundwork for growing giving
  • ◄ Place based giving
  • ◄ Future:Good
  • ◄ Research
  • ◄ Policy and Campaigns
  • ◄ Publications
  • ◄ Blogs
  • ◄ Experts and Events
  • ◄ Giving Thought blog
  • ◄ CAF Venturesome blog
  • ◄ Public Affairs blog
  • ◄ Charities blog
  • ◄ Research blog
  • ◄ Development Fund
  • ◄ Contact us
  • ◄ SAR Volunteer Training Fund
  • ◄ Vacancies
  • ◄ Contact us
  • ◄ 2019 publications
  • ◄ 2018 publications
  • ◄ 2017 publications
  • ◄ 2016 publications
  • ◄ 2015 publications
  • ◄ 2014 publications
  • ◄ 2013 publications
  • ◄ 2012 publications
  • ◄ 2011 publications
  • ◄ 2010 publications
  • ◄ 2009 publications
  • ◄ 2008 publications
  • ◄ Archive
  • ◄ Contact us
  • ◄ How do we help protect you
  • ◄ How to keep yourself safe
  • ◄ Be aware - types of threat
  • ◄ How to spot a bank scam
  • ◄ Seen something suspicious
open login menuclose login menu

Log in

CAF accountManage your:
CAF American Donor Fund
CAF Charity Account
CAF Charitable Trust
CAF Company Account
CAF Charity Dashboard
CAF Donate
CAF Give As You Earn
CAF BankManage your bank account
InvestmentsManage your CAF Investment Account
Register
  1. Home
  2. >
  3. I'm an individual
  4. >
  5. Impact through philanthropy
  6. >
  7. Evidence vs impact: the basics
Martin

Martin de Dios

Private Client Advisory Manager

Twitter logo

@caf

Evidence vs impact: The basics

In this series we explore the use of evidence for understanding impact and the issues surrounding its use. We look into how it can inform charities’ work and guide donors in deciding what to fund; the difficulties in finding good evidence and what you should be looking for as a donor, as well as the moral and ethical considerations around its use.

The ultimate goal of any donor is to make a difference with their funds, no matter what the cause is. But with so many different organisations working on the same issues, how do you decide which organisation or programme is the best use of your donation?

Perhaps you’re already donating and wondering how to monitor whether your donations are making a difference.

In both cases, this is where evidence comes in.

What do we mean by impact and evidence?

‘Impact’ is the word of the moment in philanthropy, the charity sector and even investing. While everyone wants to be impactful, what’s missing is an agreement or understanding of what that means. At CAF, we define impact and evidence as:

  • Impact: the final, often long-term, positive result of a programme, such as eradicating polio.
  • Evidence: proof – ideally independently assessed – that a programme or intervention works in its intended way. 


Why is evidence important for achieving impact

To truly understand your impact, you need data to show that the particular programme or intervention you’re funding works the way it was supposed to, and makes a positive difference to beneficiaries. This can be obtained by finding the counterfactual – what would have happened were it not for the particular programme or intervention – as well as other methods detailed below. You also need to be able to tell whether any results have been sustained, bringing long-term benefits for the beneficiaries.

The only real way to know this? Hard evidence.

If a charity can provide a robust impact evaluation to show that their programme is working as designed, or that it’s following a well-evidenced approach, you know they’re likely to achieve a good impact. On the other side, a lack of evidence can lead to programmes that are ineffective or, at worst, even cause harm. There are some situations, however, where evidence is harder to come by or simply won’t warrant an evidence base – such as brand new interventions, systems change or campaigning work – which we explore in our Evidence vs impact: questioning the use of evidence article.

But solid evidence can help charities – and you – understand what works, for whom and why, so that they can realise their missions. Collecting evidence about their programmes helps charities make better decisions, become better equipped to deal with the complexities of social issues, improve efficiencies and resource management, and ultimately learn from experiences to improve in the future.

Evidence doesn’t have to accompany a specific programme, it could be that external data is used to inform the approach of a programme. For example, numerous studies have shown that cash grants are more effective for poverty reduction than in-kind payments, despite the popularity of in-kind payments among some donors. Charities can therefore use this external evidence to inform their programmes and use cash grants.

Looking at an organisation’s external evidence base is always important when deciding which organisation to support, particularly if they lack their own. When they don’t have in-house or external monitoring and evaluation processes in place, donors should find out more about how an organisation informs their work and how their programmes have been set up. If they don’t have the relevant data but you know that they are following an evidence-based approach, such as the cash grants example above, then you can be somewhat confident that the approach is one demonstrated to be impactful.

Identifying the good evidence from the bad

There are several different kinds of evidence, indeed there is a whole hierarchy, and different types will be appropriate for different circumstances.

So what types of evidence really matter?

There are three main types of evidence that are good to look out for:

  • Randomised control trials: these are the gold standard in understanding whether an intervention works in its intended way and the difference it’s made to beneficiaries. This is because they establish a causality, a link between the output and the longer-term impact of the outcomes, such as the counterfactual. They don’t, however, include how the programme is implemented or the way the beneficiary feels about it.
  • Consistent qualitative evidence: obtained for example through a survey, qualitative evidence will be most useful to understand the beneficiaries’ perspective of a programme. It’s quite low on the hierarchy of evidence, but when it comes to reporting beneficiary experience, it’s good evidence to use.
  • Process evaluations: focused on how interventions work and why they deliver certain results, process evaluations allow you to ‘go behind the results’ of an evaluation. They are particularly useful when understanding how complex interventions work, what may have gone wrong in the delivery of an intervention and how it could be changed for a different environment.

Beware, however, of other information in impact reports or charities’ websites presented as evidence but lacking actual data.

One example is the use of reach (reporting on outputs) as evidence of impact (outcomes). A charity may claim to have reached a certain number of beneficiaries (the outputs of their work), but what they’re missing is insight into the impact they’ve had on those people – and evidence to prove it (outcomes of the intervention). Independently assessed evaluations will be able to demonstrate the link between what the charity has done and how it has helped those beneficiaries.

Information on the charity’s outputs, stories, and short-term outcomes, while interesting, also don’t amount to useful data for truly assessing long-term impact.

How to marry evidence and impact in your giving

The first step in adopting an evidence-based approach to your giving is to look for a charity’s evidence base and identify how they’re monitoring and evaluating their work, so you can understand what’s working.

Choosing to donate to organisations that use evidence effectively in their decision-making process will ensure you make a greater impact with your funds and can help you develop trust in the organisation before you support them. Once you trust that the organisation uses donations effectively and is making a long-term difference, you may be more inclined to provide unrestricted funding that charities can use more flexibly.

Be mindful, however, of when evidence is necessary and when it may be harder to come by. Of course, a charity may simply not have the evidence base needed due to a lack of funds or skills. If this is the case, ask if their programmes are being informed by externally produced evidence. If so, you can be somewhat more confident than if they’re not following a well-evidenced approach.

Another option may be to use the opportunity to step in and facilitate that work. Consider funding the evaluation of a programme’s work to produce independently-assessed evidence for a better understanding of the impact it is having. This can be a good way to have philanthropic leverage.


You can find out more about the use of evidence in measuring your impact in our other articles:

  • Evidence vs impact: finding the evidence
  • Evidence vs impact: questioning the use of evidence

 

Learn how we help our clients make a difference with their giving.

  • Individuals
  • Donate now
  • CAF Charity Account
  • CAF Charitable Trust
  • CAF Charitable Legacy Service
  • CAF American Donor Fund
  • Giving to charity
  • Your philanthropy
  • Resource centre
  • Companies
  • CAF Give As You Earn
  • CAF Company Account
  • Corporate responsibility
  • Engaging employees
  • Corporate community
    investment
  • Charities
  • Everyday banking
  • Borrowing
  • Social investment
  • Investments
  • Fundraising services
  • Expert Advice
  • CAF Bank
  • Current account
  • Loans
  • Help and support
  • About CAF Bank
  • Security
  • About us
  • Governance
  • International giving
  • Research and commentary
  • Careers
  • Press office
  • Sustainability
CAF home
CAF on facebook
CAF on twitter
CAF on youtube
CAF on linkedin
CAF on Instagram
  • Contact us
  • Help
  • Sitemap
  • Accessibility
  • Privacy
  • Cookie notice

Modern Slavery Statement


Charities Aid Foundation © | Registered Charity Number 268369
25 Kings Hill Avenue, Kings Hill, West Malling, Kent ME19 4TA
10 St. Bride Street, London EC4A 4AD
Telephone: 03000 123 000