Our site places cookies on your device to give you the best experience. You can change your cookie settings at any time. Our Privacy Notice has more information on how to do this. I’m happy, please close this message

CAF: Charities Aid Foundation CAF: Charities Aid Foundation Skip to main content
Donate to a charity
Register
Log inClose CAF account drop-down menuLog in to your CAF account
CAF accountManage your:
CAF American Donor Fund
CAF Charity Account
CAF Charitable Trust
CAF Company Account
CAF Charity Dashboard
CAF Donate
CAF Give As You Earn

CAF BankManage your bank account
InvestmentsManage your CAF Investment Account
Search

Search

Search box
open menu close menu Menu Close
Donate to a charity
  • ◄ I'm an individual ►
  • ◄ I'm a company ►
  • ◄ I'm a charity ►
  • ◄ International giving ►
  • ◄ CAF Bank ►
  • ◄ About us ►
  • Careers
  • For charities
  • For individuals
  • For philanthropists
  • For companies
 
  • ◄ Giving to charity > ►
  • ◄ Private Client Philanthropy > ►
  • ◄ Know more about giving > ►
  • ◄ Help and support > ►
  • ◄ Donate now > ►
  • ◄ Leave a lasting legacy
  • ◄ Grantmaking through us
  • ◄ Services for professional advisers
 
  • ◄ Employee giving > ►
  • ◄ Employee engagement > ►
  • ◄ Corporate giving > ►
  • ◄ Corporate and workplace fundraising
  • ◄ Impact advisory
  • ◄ Corporate grantmaking
  • ◄ Resource centre > ►
 
  • ◄ Cost-of-living resources
  • ◄ Everyday banking > ►
  • ◄ Savings > ►
  • ◄ Loans and social investment > ►
  • ◄ Investments > ►
  • ◄ Fundraising > ►
  • ◄ Your donations > ►
  • ◄ Grantmaking > ►
  • ◄ Strategic consultancy > ►
  • ◄ Legacies > ►
  • ◄ Trustees and charity governance
 
  • ◄ Philanthropy Week
  • ◄ Powering world giving
  • ◄ CAF Network
  • ◄ Memberships
  • ◄ Give anywhere safely
  • ◄ Give internationally
  • ◄ Emergency response
  • ◄ Our reach and impact
 
  • ◄ Everyday banking > ►
  • ◄ Loans > ►
  • ◄ Savings > ►
  • ◄ Help and support > ►
  • ◄ About CAF Bank > ►
  • ◄ Security centre > ►
 
  • ◄ Governance > ►
  • ◄ Research and Commentary > ►
  • ◄ Press office > ►
  • Sustainability
 
  • ◄ Connecting you to charities
  • ◄ Open a giving account
  • ◄ Donate overseas
  • ◄ Payroll giving
  • ◄ Leave a lasting legacy
  • ◄ Manage your giving through us
  • ◄ CAF Charitable Trust
  • ◄ Paying Tax in the UK and US?
  • ◄ Become a social investor
  • ◄ Get expert consultancy
  • ◄ Meet the Team
  • ◄ Our tips, guides and information
  • ◄ Gift Aid
  • ◄ Tax efficient giving
  • ◄ Donating
  • ◄ CAF Charity Account
  • ◄ CAF Charitable Trust
  • ◄ Payroll giving
  • ◄ Expert consultancy
  • ◄ Grantmaking
  • ◄ Find a UK charity
  • ◄ CAF Give As You Earn
  • ◄ Grow your Payroll Giving scheme
  • ◄ Matching your employee donations
  • ◄ Get your Payroll Giving Quality Mark
  • ◄ Start engaging employees with charitable giving
  • ◄ Find out more about Payroll Giving
  • ◄ Payroll Giving resource hub
  • ◄ CAF Company Account
  • ◄ Set up a corporate foundation
  • ◄ Manage your corporate grantmaking
  • ◄ Corporate giving insight
  • ◄ Corporate giving case studies
  • ◄ Meet the Team
  • ◄ Get in touch
  • ◄ Everyday charity banking
  • ◄ Online banking
  • ◄ CAF Bank Business card
  • ◄ Taking card payments
  • ◄ Bacs bureau service
  • ◄ Borrowing options
  • ◄ Secured loans with CAF Bank
  • ◄ Social investment with CAF Venturesome
  • ◄ Savings accounts
  • ◄ Instant access savings account
  • ◄ 60 Day Notice Account
  • ◄ 90 Day Notice Account
  • ◄ 12 Month Fixed Rate Saver
  • ◄ 1 Year Fixed Term Account
  • ◄ CAF Charity Deposit Platform
  • ◄ Investment products
  • ◄ Investment Knowledge Centre
  • ◄ Getting started
  • ◄ Fundraising tips and advice
  • ◄ CAF Donate
  • ◄ CAF Charity Dashboard
  • ◄ How to redeem CAF Charity Vouchers
  • ◄ CAF Donate Help
  • ◄ CAF Charity Dashboard
  • ◄ CAF Charity Dashboard Reporting
  • ◄ Sign up
  • ◄ CAF Charity Dashboard Help
  • ◄ Grantmaking with CAF
  • ◄ Getting a grant
  • ◄ Contact us
  • ◄ Supporting charity development and resilience
  • ◄ Meet the Team
  • ◄ Contact us
  • ◄ Legacies and your charity
  • ◄ Contact us
  • ◄ Contact us
  • ◄ FAQs
  • ◄ Tools and guides
  • ◄ Current account
  • ◄ Online banking
  • ◄ CAF Bank Business card
  • ◄ Taking card payments
  • ◄ Bacs bureau service
  • ◄ Interface for Third Party Providers
  • ◄ Secured loans
  • ◄ Loans for social housing projects
  • ◄ Social purpose development finance
  • ◄ Charity finance guides
  • ◄ Charity finance case studies
  • ◄ Intermediaries - Working with us
  • ◄ Instant access savings account
  • ◄ CAF savings options
  • ◄ We're here to help
  • ◄ Security centre
  • ◄ Protecting your money
  • ◄ Making a complaint
  • ◄ About us
  • ◄ CAF Bank Board of directors
  • ◄ CAF Bank Executives
  • ◄ Meet the team
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ CAF Bank Pillar 3 disclosure (.pdf opens in new window)
  • ◄ CAF Bank Board Directors
  • ◄ CAF Bank Executives
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ CAF Bank Pillar 3 disclosure (.pdf opens in new window)
  • ◄ Complaints procedure
  • ◄ Our trustees
  • ◄ Our executive
  • ◄ Committees
  • ◄ Annual reports
  • ◄ Our Standards and Conduct Policy
  • ◄ Legal information
  • ◄ Regulatory information
  • ◄ Complaints procedure
  • ◄ Giving Tuesday
  • ◄ Champion for charities
  • ◄ Groundwork for growing giving
  • ◄ Place based giving
  • ◄ Future:Good
  • ◄ Research
  • ◄ Policy and Campaigns
  • ◄ Publications
  • ◄ Blogs
  • ◄ Press releases
  • ◄ Spokespeople
  • ◄ Giving Thought blog
  • ◄ CAF Venturesome blog
  • ◄ Public Affairs blog
  • ◄ Charities blog
  • ◄ Research blog
  • ◄ Development Fund
  • ◄ Contact us
  • ◄ SAR Volunteer Training Fund
  • ◄ Vacancies
  • ◄ Contact us
  • ◄ 2019 publications
  • ◄ 2018 publications
  • ◄ 2017 publications
  • ◄ 2016 publications
  • ◄ 2015 publications
  • ◄ 2014 publications
  • ◄ 2013 publications
  • ◄ 2012 publications
  • ◄ 2011 publications
  • ◄ 2010 publications
  • ◄ 2009 publications
  • ◄ 2008 publications
  • ◄ Archive
  • ◄ Contact us
  • ◄ How do we help protect you
  • ◄ How to keep yourself safe
  • ◄ Be aware - types of threat
  • ◄ How to spot a bank scam
  • ◄ Seen something suspicious
open login menuclose login menu

Log in

CAF accountManage your:
CAF American Donor Fund
CAF Charity Account
CAF Charitable Trust
CAF Company Account
CAF Charity Dashboard
CAF Donate
CAF Give As You Earn
CAF BankManage your bank account
InvestmentsManage your CAF Investment Account
Register
  1. Home
  2. >
  3. I'm an individual
  4. >
  5. Impact through philanthropy
  6. >
  7. Evidence vs impact: Finding the evidence
Aurelia headshot

Aurelia Kassatly

Principle, ESG and Impact Projects

Twitter logo

@caf

Evidence vs impact: Finding the evidence

As we’ve discussed, the use of evidence when measuring impact is extremely important for both charities and donors. But how can you find the right evidence to understand the impact of an organisation or programme? Do impact reports have the answers? We explore what you should be looking for and why it’s often so hard to find. 

We thank philanthropy expert Rhodri Davies; Matthew Whittaker, CEO of Pro Bono Economics (PBE); and Caroline Greenhalgh, PhD Candidate at the University of Birmingham and Head of Development at the Childhood Trust, for sharing their expertise on impact and evidence in philanthropy for this article.

 

Do impact reports demonstrate evidence?

Your first port of call for finding evidence may be to look at a charity’s latest impact report. There are plenty being produced by charities. But Rhodri and Matthew both think this is because donors expect them and are asking for them, not because charities see the benefits of producing them for themselves. This is leading to several consequences.

The first, according to Matthew, is that charities tend to view impact reporting as a way to secure more donations. This has led to the rise of ‘snake oil salesmanship’ and a proliferation of organisations claiming to measure donor impact, while simply sharing outputs, stories and short-term outcomes, without robust long-term evidence. 

The second, according to Rhodri, is that it’s the donor rather than the charity who is deciding the impact a charity should have. Donors often come to an organisation offering significant donations for a specific programme or idea in mind, expecting diligent reporting and results. In reality, the initiative may not fit the charity’s mission, nor be how they’d choose to use the money given the choice.

 

Why is good evidence hard to come by?

In Caroline’s PhD research, she found that there was not nearly enough robust evidence available, while some donors felt overwhelmed by the amount of information provided and didn’t have the skills to evaluate its quality.

So why is good evidence so difficult to find?

1. Lack of good data

Many charities simply don’t have the evidence base to prove their impact. The format of information shared by charities is also often inconsistent, claims Matthew, with little indication of how the programme helped beneficiaries over time. This means that charities may be able to report on outcomes but find it difficult to prove longer-term impact.

2. Lack of skills and knowledge

To develop a strong evidence base, you need data scientists and economists – skills that charities don’t normally have in-house. Equally, funders often don’t have these backgrounds and so don’t know what to look or ask for.

3. Lack of funds

Most charities don’t have the funds to recruit for these skills. It’s also more difficult for charities to secure general funds that can enable them to step-back and assess what and how they are doing. Donors also tend to give restricted funds to deliver specific programmes. The result is that charities have little room to take on additional work beyond programme delivery. The pandemic has increased donor awareness on the importance of unrestricted donations, particularly during the initial emergency phase, something that we hope will continue. 

4. Lack of infrastructure

As there is no centralised platform to share evidence on charitable programmes, its use and dissemination is severely hampered. 

How can impact reporting be better for charities and donors?

Evidence building should not be done to secure more donations. It should primarily be about helping the charity understand the benefit of their work and how they can improve.

It’s also very common for different donors supporting the same charity or project to request different impact reports all with their own requirements. This naturally places a heavy burden on the charities. Ultimately, there needs to be a more joined-up and efficient way of demonstrating impact. 

If donors have researched the evidence base for a charity’s work and feel confident in the long-term benefits of that work before they donate, they may feel more confident in making unrestricted donations and attaching fewer reporting requirements to the grant itself.

 

What evidence should donors be looking for?

When looking for evidence of impact from a charity, our contributors recommend:  

  • Finding out the methodology or logic behind how they have collected and interpreted their programme data.

  • Looking for the long-term benefits. Ask about how the evidence shows, if any, the long-term benefits for beneficiaries.

  • Asking yourself how fantastical the claims are. If they are making claims that are absolute, rather than relative, explore that with them.

  • Looking for the counterfactual. Most importantly, ask if the charity has a control group that their programme can be compared against so you can understand what might have happened otherwise.
 

Look out too for the three main types of evidence we covered in our Evidence vs Impact: the basics article: randomised control trials, consistent qualitative evidence, and process evaluations.

You can find out more about the use of evidence in measuring your impact in our other articles:

  • Evidence vs impact: the basics
  • Evidence vs impact: questioning the use of evidence

Learn how we help our clients make a difference with their giving
  • Individuals
  • Donate now
  • CAF Charity Account
  • CAF Charitable Trust
  • CAF Charitable Legacy Service
  • CAF American Donor Fund
  • Giving to charity
  • Your philanthropy
  • Resource centre
  • Companies
  • CAF Give As You Earn
  • CAF Company Account
  • Corporate responsibility
  • Engaging employees
  • Corporate community
    investment
  • Charities
  • Everyday banking
  • Borrowing
  • Social investment
  • Investments
  • Fundraising services
  • Expert Advice
  • CAF Bank
  • Current account
  • Loans
  • Help and support
  • About CAF Bank
  • Security
  • About us
  • Governance
  • International giving
  • Research and commentary
  • Careers
  • Press office
  • Sustainability
CAF home
CAF on facebook
CAF on twitter
CAF on youtube
CAF on linkedin
CAF on Instagram
  • Contact us
  • Help
  • Sitemap
  • Accessibility
  • Privacy
  • Cookie notice

Modern Slavery Statement


Charities Aid Foundation © | Registered Charity Number 268369
25 Kings Hill Avenue, Kings Hill, West Malling, Kent ME19 4TA
10 St. Bride Street, London EC4A 4AD
Telephone: 03000 123 000