Category Archives: Impact Evaluation

Achieving Empowerment

Harriet Agyemang, Programme Manager at SEND-Ghana, presents at the Greater Accra Regional Policy Dialogue on the District Assembly Common Fund
Mrs. Harriet Agyemang, Programme Manager at SEND-Ghana, presents at the Greater Accra Region Policy Dialogue on the District Assembly Common Fund

One of the ways that development projects and programmes aim to promote good governance is through the empowerment of citizens in developing countries. At its most basic, the idea is that an empowered, active citizenry can influence government officials and institutions so that their interests and ideas are represented in government planning. It’s a fairly simple idea.

In practice, however, trying to empower people is quite difficult. Empowerment is not very tangible – you can’t dump packages of empowerment off the back of a cargo plane, nor can you build an empowerment well in a rural village. It’s not even as simple as educating or training citizens in how to be active citizens (though it is often a requirement).

 “Empowerment is the process of increasing the assets and capabilities of individuals or groups to make purposive choices and to transform those choices into desired actions and outcomes” – World Bank

It probably helps to start with a definition. I think the World Bank’s definition, above, is a nice, broad definition of what it means to be empowered. At the same time, it doesn’t say an awful lot about how to get there.

The reality is that the ability of citizens to make choices and to transform them into actions and outcomes depends on much more than their own capacity or understanding. It depends on the broader socio-political context. Citizens are embedded in intricate networks of power relations shaped by factors such as gender, ethnicity, wealth, geography (though this article has a point), history and politics.

Citizens need information in order to make informed choices and to promote government accountability. Access to information depends on having a transparent government. Influencing the government requires that citizens can understand and use information, and that they have access to platforms (democratic space) where they can voice their thoughts and concerns.

Efforts must be made to build capacities across the entire range of community groups if empowerment efforts are to avoid further marginalising groups that are under-represented and disadvantaged (e.g. women, certain ethnic groups, people with disabilities).

Citizen empowerment therefore requires that development programming looks at the wider network in which citizens are embedded. With this in mind, I am quite impressed so far with the theory behind SEND‘s Grassroots Economic Literacy and Advocacy Programme. It brings together representatives of a wide range of community groups, and provides capacity building so that they can carry out research and monitor the implementation of pro-poor programmes under Ghana’s Growth and Poverty Reduction Strategy. In addition, SEND publishes the research findings, and facilitates citizen-government engagement and advocacy at the district, regional and national levels. Other interesting ‘cutting edge‘ approaches to empowerment focus on harnessing the potential of technology, such as Twaweza and the Making All Voices Count initiative.

Even if we have an idea, in theory, of what it takes to achieve empowerment, how can we be sure we’ve achieved it? As an impact evaluation officer, this is something I’m working on. We also have to question whether empowerment is an end in itself, or if it is a means to an end. In the case of the latter, how can we show that empowerment has had the desired effects? Has it improved governance? Has it contributed to poverty alleviation? The answers to these questions will hopefully become clearer as I get stuck into my research here in Ghana. For the time being, it would be great to hear about any readers’ thoughts and ideas.

Impact Evaluation: Finding What Works

As the skills and knowledge of people in developing countries continue to increase, is there a role in developing countries for Western development workers? I was asked this question during a recent job interview. It’s an important question. Although I drew, in my answer, upon the (idealistic) cliché of development workers working with the objective of putting themselves out of work, there’s probably more to it than that.

Over the past few days though, I’ve been reminded of an even deeper existential crisis within the development field. Several casual conversations I’ve had with people I’ve met here in Ghana (we development folk know how to keep it light!), as well as recent high-profile critiques – such as that levelled at celebrity economist Jeffrey Sachs (author of End of Poverty, Bono’s best buddy, and aid champion) in Nina Munk’s The Idealist – reflect an endemic uncertainty among development professionals: does aid make a difference? Or in other words, do the hundreds of billions of dollars being spent each year contribute to positive change?

That I’m not the only one looking for the answer to this question might be more disconcerting than it is reassuring. It’s a question that marks a deep chasm between some of the most influential thinkers in international development. For skeptics such as William Easterly and Dambisa Moyo, aid is, at best, a waste of money, and, at worst, more harmful than helpful. For others, such as the vilified Sachs*, it’s simply a matter of needing to spend more.

For me, the key is learning about what works. It might look like a cop-out, like I’m avoiding having to take a stance. In reality, however, I believe there are projects that can produce sustainable results, and that by promoting accountability (in terms of demonstrating impact) and transparency, we can avoid some of the potential problems (such as dependence, corruption, and ineffectiveness) discussed by aid skeptics. In other words, by putting the onus on development NGOs and governments to credibly demonstrate the impact of their aid expenditure, we can improve their accountability to donors and to the beneficiaries themselves. Furthermore, it enables us to learn about what works and to make better decisions on future expenditure.

Learning about what works requires rigorous impact evaluation. In Poor Economics, for instance, Banerjee and Duflo present some remarkable findings from the application of randomized control trials (RCTs) (like those used to test the effects of medicine in clinical trials) to social projects. While there are other means of carrying out impact evaluations, and RCTs aren’t everyone’s cup of tea, this post has to end somewhere and I don’t have the space to get into that right now (though I’d love to hear the thoughts of others – I’m a fan!).

My point is this: while the philosophical questions are important, they have a tendency to generate a lot of greyness. Impact evaluation, on the other hand, when done properly, can allow us to look through the greyness, and find what works.

* As someone who spent three months researching the impacts of electrification at Sachs’ Millennium Villages Project in Rwanda, I’d like to say my findings pointed to positive changes in the livelihoods of those that accessed electricity. While the  Millennium Villages Project might not have had the macro-level impacts that Sachs had hoped for, there are surely lessons there to be learnt and some successes that can be replicated. At the very least, Jeffrey Sachs succeeded in drawing widespread mainstream attention to poverty and in defining sustainable development as a global concern.