What does “real impact” mean?

Making decisions based on data

Collecting and analyzing data from our programs is a critical part of World Vision’s work and central to our charitable impact. We partner with communities as we measure the results of our joint efforts—this keeps us accountable to the children and families we serve, as well as to the donors who support us. Our data collection methods prioritize hearing the voices of both men and women in equal measure to ensure historical power imbalances are not perpetuated.

We begin collecting data in the early stages of project planning and assessment. Over the course of a project, continuous data collection cycles, assessments and, where appropriate, evaluations allow us to analyze the changes communities are experiencing. The data can be both quantitative (numerical, measurable) and qualitative (descriptive, experiential) and the changes we measure may be positive or negative. We use the learnings to make short-term changes and improvements, and to inform the way future projects are planned.

Using the right words as we work toward Real ImpactTM

Evaluating our effectiveness is the most accurate way to know that a community is indeed better off, and that we are truly doing more for the girls and boys we serve. However, in the world of international development, we often see words like progress, change and impact used interchangeably. That creates confusion for people trying to understand the effect of our work—because when it comes to measuring results, these words carry specific meanings.

Defining progress, change and impact

• Progress reflects the results of our activities. For example, how many women received business training, how many malnourished boys were treated or how many gender-sensitive latrines were installed. We have a high degree of certainty with these results simply by doing quality work with communities as we implement projects.
• Change is the transformation that results from a project’s progress. For example, how many women increased their profits, how many boys recuperated from malnutrition or how many more girls are attending school thanks to latrines that take their needs into account. Culture, environment and behaviour all play roles in change, so we have less certainty with the results—and measurable change may take years to see.
• Impact is the true measure of transformation. The Organisation for Economic Co-operation and Development defines impact as “positive and negative, primary and secondary long-term effects produced by a development intervention, directly or indirectly, intended or unintended.” This means that impact looks beyond the basics of what happened in a given project and seeks to understand what role the project had in creating those particular effects in a community over a period of time.

This is the definition World Vision Canada uses when we talk about Real ImpactTM: measurable change in people’s lives, with evidence that our programs—not external factors—made the difference.

Working for Real ImpactTM together with communities

World Vision takes this a step further as we design our projects: we don’t just strive for positive impact—we focus on sustainable, long-lasting, transformative impact that can only be achieved through close partnerships with communities and their governments and institutions, addressing the root causes of poverty and injustice.

It’s important to note that at times, circumstances, like a sudden change in a country‘s stability, may force us to alter course. In these situations, helping families simply survive the present may take priority over longer-term solutions. Even so, with our community-led program approaches and strategies that centre the family, we’re working toward change that transforms people’s lives and sets a new trajectory for the generations that follow.

These are long-term goals; some may only be achieved through the work of multiple projects, and even then the results may not be seen until after the projects end. This makes impact measurement all the more important, because it tells us whether our work is creating the right kind of change.

Measuring the value of our Real ImpactTM

We see value in every positive change we can make for any child. When it comes to understanding the overall impact we’ve made, however, understanding the monetary value of a project—including its long-term economic benefits to society—is essential. This information prepares us to make better decisions.

Understanding the total costs that go into a program—including factors like the time required by community volunteers, for example—allows us to compare the program’s cost against its results. This gives us a measure of the program’s efficiency, which is useful when deciding whether to use that approach—or a different one—in the future. It also provides a benchmark for comparison with other groups doing similar work.

World Vision is committed to creating a better future for the world’s most vulnerable children. Understanding the long-term social value of the work we are doing helps move us toward that goal, equipping us to steward our donors’ money with wise investments so that, ultimately, we can do the most good for the children we serve.

Cost-benefit analysis findings for further reading

Are you interested in learning more about the Real ImpactTM Canadians have supported through World Vision Canada’s programs in the past few years? Here are some recent evaluation findings.

• How we help feed a hungry world: Evaluating our food assistance programs
• Savings groups: A little saving, a lot of progress
• How well do World Vision’s livestock programs work?
• Simple, effective agriculture: A summary of Farmer-Managed Natural Regeneration

Note: Our Real Impact™ logo and trademark presents the validated standard of our organization to evaluate the attribution of change measured, and its effectiveness and efficiency. It serves as an industry model to enhance trust and transparency with our stakeholders.