Includes Voice Navigation and reading tools. Press Enter or Space to open it. Then move to the Navigation section and activate the Voice Navigation button to start listening.
← Back to Posts
DA

1 hour ago

Measuring Impact: Numbers Tell You How Much; Stories Tell You What Mattered

In our constant effort to build inclusive and just communities, one question follows us into every report we write and every donor we address: did we make a real difference? Our quantitative indicators answer "how much" with confidence how many trainings, how many beneficiaries, what percentage. But they fall silent before the deeper question: what actually changed in a human life? And what mattered to them, not to us?

This is where the Most Significant Change method enters a participatory evaluation approach designed for exactly the complex situations that numbers alone cannot hold. Its idea is at once simple and radical: instead of dictating the criteria of success, we gather change stories as people lived them, and then let them not us choose which story is the most significant, and say why.

I return often to a documented case from the West Bank: the Partnerships with Youth project, which applied this method in 2018. The project did not merely collect stories; it went further. It trained twenty young people themselves beneficiaries to become the researchers. They ran the story circles, and they asked their peers a single question: "What has been the most significant change in your life since joining?" They gathered 178 stories, from which participants selected ten as the most significant, by criteria they set themselves.

Consider what happened there. The beneficiary became the researcher. That is, at its core, "Nothing About Us Without Us" applied to measurement itself. We do not stop at involving persons with disabilities and marginalised youth in designing programmes; we involve them in judging their impact. And whoever holds the right to define "most significant" holds real power and for once, that power passed to the people who lived the experience.

What is more, the stories revealed what numbers never could. When the young researchers sorted their stories, four domains of change emerged: personal, social, economic, and academic. The surprise was that the personal domain dominated by a wide margin self confidence, the courage to speak before others, a sense of worth. More striking still, that personal change was often the seed from which economic change later grew: the young man who recovered his confidence was the one who dared the job interview; the young woman who broke the barrier of fear was the one who led a community initiative. A number alone would never have shown us that delicate human sequence.

But a story, however moving, needs credibility. So the method did not rest on the beneficiary's account alone. The researchers conducted forty interviews with other witnesses staff, board members, family, other youth to verify that what the young people reported matched what those around them had seen. This triangulation is what turns a story from a passing impression into evidence you can stand on. Qualitative measurement is not methodological leniency; it is discipline of a different kind.

How does a reader apply this in their own organization, even a small one with no research budget? It is simpler than it seems. Gather a small group of beneficiaries in a circle and ask them the same question: "What is the most significant change in your life because of us?" Give each a few minutes to tell their story, then ask the group to choose together the most significant one and to explain why they chose it. That "why" is the real treasure of evaluation, because it reveals what your community actually values. Document the stories, and invite an independent witness to confirm them. You need no more than a notebook, a listening ear, and respect for the one who speaks.

In my work with Kayan and Masarat, and with African and global networks, I have seen how a single honest story can persuade a donor or a minister where twenty pages of tables cannot. Not because numbers have no value but because real impact lives in meaning, and meaning can only be told in the voice of the one who lived it.

Impact is not what we do; it is what remains in a human life after we are gone. And the only way to know it is to be humble enough to ask the people who lived it and then to listen. So begin today by asking your community one question: what actually changed as you see it?

Comments (0)