Our Work in Action
Do you want to know how impact measurement is operationalised in different projects? See a range of projects below for which we have carried out impact measurement evaluations.
Employment, resilience and social cohesion in the Sahelian strip and Lake Chad Area (2017-2021)
Wujood: Strengthening the resilience of vulnerable Palestinian communities in East Jerusalem (2017-2019)
1. Strategic Partnership towards a worldwide influencing network
The Strategic Partnership programme, “Towards a worldwide influencing network” enables our influencing work around three thematic areas ‘Right to food’, ‘Greater responsibility in finance for development’, and ‘Conflict and fragility’. It is implemented in 23 projects spread over 17 countries in Asia and Africa. It enables us to empower people and to influence governments and private sector parties to improve policies and practices for people living in poverty and injustice. For this programme, we designed an overall approach for measuring the different outcome areas, that fit the different units of measurement; changes in people, policy makers, and organisations. The measurement approach is closely linked to a learning strategy that serves global and country specific needs. The partnership is an agreement of an alliance of Oxfam Novib and SOMO with the Dutch Ministry of Foreign Affairs. For more information on the project:https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/strategic-partnership.html
2. Empower Youth for Work
Empower Youth for Work is a five-year project that focuses on giving young people in rural areas of Pakistan, Bangladesh, Indonesia and Ethiopia opportunities to develop themselves. This project involves young people in order to tackle the main problems in their region, draw up recommendations and lobby for policy changes. We work together with young people to help them develop professional skills and meaningful social networks. The impact measurement approach is designed to contribute to evidence-based strategic decision-making and learning in the project, and therefore takes a participatory approach in which youth have a meaningful role. The purpose of the impact evaluation is to understand the pathways of change for youth from building skills to decent employment. Herein, we also focus on the enabling role the environment can have. For more information on the project: https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/empower-youth-for-work. See also the baseline reports for Pakistan, Indonesia, Bangladesh and Ethiopia.
3. 'Marriage, No Child’s Play' project
Oxfam Novib, together with Save the Children, Simavi, and the Population Council, is part of the 'Marriage, No Child’s Play project' in Pakistan. The 'More than Brides Alliance' aims to reduce child marriage and its adverse effects on young women and girls in India, Pakistan, Malawi, Niger, and Mali. We are convinced that young people, especially girls, are only able to decide if and when to marry if they are empowered to make informed decisions, if their protective assets are built, and if their community respects their rights. In Pakistan, Oxfam Novib is responsible for the impact measurement, which includes baseline, midline and endline impact measurement surveys as well as in-depth qualitative research. To ensure maximum fit with the project’s needs and with the content of the learning agenda, the project team in the country and the global project team together determine the focus of the analysis of surveys as well as the qualitative research. For more information on the project: https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/marriage-no-child-s-play. See also the baseline report of Pakistan.
4. Work in Progress!
Work in Progress! aims for a society in which young women and men as active citizens benefit from improved policies and beliefs related to quality education, and decent employment to influence future prospects for young women and men. The project focuses on the supply and the demand side of the labour market. To get insight into and measure changes in the lives of project participants, we use a mix of qualitative and quantitative data collection methods. Through surveys (predefined questionnaires used in interviews with the targeted youth who apply for the various activities) at various moments in the course of the project, and stories of change (a more open, storytelling approach based on the “most significant change” methodology), we aim to measure the changes that we envision as described in the project’s theory of change. This enables us to determine the effectiveness of our project and to learn what aspects are going well and where there is room for improvement. For more information on the project: https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/work-in-progress! See also the baseline report.
5. Women’s Empowerment, Mainstreaming and Networking programme (WEMAN)
Using the power of symbols and principles of inclusion, the WEMAN project helps rural populations to improve livelihoods and gender equality, negotiate better prices for their goods and increase their influence on local economies. Under the WEMAN programme is the IFAD-supported grant project “Integrating household methodologies in agricultural extension, value chains and rural finance in Sub-Saharan Africa” co-funded by Oxfam Novib. This project grant implemented in Rwanda, DRC and Burundi is one of the projects under the global WEMAN programme. To measure impact in this specific project, we designed a different impact measurement methodology. This difference in methodology is mainly due to the circumstances prevailing in Rwanda, Burundi and DRC, making it difficult for our partners to actively participate in some of the data collection activities. Hence, we have designed a mixed-methods methodology for Rwanda, and a qualitative methodology for Burundi and DRC. For more information on the project: https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/weman. See also the WEMAN baseline report.
6. Transboundary Rivers of South Asia
This programme aims at reducing poverty of river basin communities in three large river basins. We envisage that poverty will be reduced for marginalised and vulnerable river basin communities through increased access to and control over water resources. Impact measurement in this project contributes to evidence-based strategic and financial resources management. By measuring changes at outcome level, we learn about how to make change happen and improve the effectiveness of our work. Moreover, it allows the implementing partners to be accountable for their contribution to a just world without poverty to the people that participate in our programmes as well as our donors. For more information on the project: https://nepal.oxfam.org/press_release/oxfam-launches-trans-boundary-water-governance-project-nepal
7. Empowering Local and National Humanitarian Actors (ELNHA)
This project focuses on strengthening the role of local and national humanitarian actors in disaster-affected Uganda and Bangladesh. The ELNHA project works towards building a new humanitarian model that gives responsibility and leadership to local and national humanitarian actors in Bangladesh and Uganda. The belief is that, with the right investment, local and national communities and organisations will be able to save more lives in a crisis and affected communities will come back stronger afterwards. The impact evaluation focuses on the quality of the humanitarian responses implemented by local and national humanitarian actors, supported by the ELNHA project. The data that inform this evaluation are solely the views of crisis-affected people who have benefited from the humanitarian responses. People expressed their views during focus group discussions and one-on-one interviews.For more information on the project: https://www.oxfamnovib.nl/donors-partners/about-oxfam/projects-and-programs/elnha.html
8. Enough campaign
Violence against women and girls is a hidden global crisis which knows no boundaries of geography or culture. But, marginalised women, such as poor women and girls, are most likely to experience it, often at the hands of their husbands or partners. Violence against women and girls takes many different forms, including domestic violence, sexual assault and harassment, child, early and forced marriage, sex trafficking, so called ‘honor’ crimes and female genital mutilation. As part of this project, Oxfam Novib conducts formative research in Tunisia and Nigeria to ensure the national campaigns have a clear focus on social norms that are perpetuating violence against women and girls. The findings of qualitative research were directly translated into campaign strategy in a participatory process with researchers, campaigners, partners and role models. For more information on the project: https://www.oxfam.org/en/campaigns/enough. See also the working paper.
9. Employment, resilience and social cohesion in the Sahelian strip and Lake Chad Area
The project ultimately seeks to improve the well-being of the targeted populations, by improving food and nutrition security for poor and very poor households, by increasing youth and women’s access to employment opportunities and income, and by fostering social cohesion within communities. In order to ensure accountability and promote evidence based learning, a critical component of this project is an impact evaluation, to embed a culture of learning and evaluation. A quasi-experimental design assesses the effect of the programme by comparing the changes in outcomes of the target group to the changes in outcomes of the comparison group. The two groups (target and comparison) are compared on resilience outcomes of households, women and young people to shocks and stressors and the impact on the well-being outcomes including food security and children’s nutritional status, employment opportunities, income and improved social cohesion. This longitudinal study is complemented with qualitative research about how change happens.
10. Wujood: Strengthening the resilience of vulnerable Palestinian communities in East Jerusalem
The overall objective of this project is to contribute to strengthening the resilience of vulnerable communities in East Jerusalem. The specific objective is to promote the active participation of Palestinian communities and civil society in the Old City, Silwan, Al Tur, Esawiyyeh and Sur Baher to access and protect their social, legal and economic rights. Given the diverse range of activities and outcome areas covered by the Wujood project, different monitoring and evaluation approaches are proposed for the different expected results. This allows the application of robust quantitative (randomised controlled trial) and qualitative evaluation methods to measure the key result areas of the project.
11. Tunisia Safe Spaces
This edutainment project formed part of Oxfam’s Violence Against Women programme in Tunisia, aiming to change attitudes and behaviours with regards to violence against women. Partners organised listening sessions of an Egyptian edutainment radio series called “Worth 100 Men”, followed by facilitated discussions on the themes of the series. The impact evaluation investigated whether the Egyptian radio series and discussion groups were successful in changing knowledge, attitudes and perceptions of social norms with regards to women’s empowerment and violence in Tunisia. Partner organisations identified a total of 300 potential project participants within their local communities, who were randomised into a target and control group. A baseline and endline survey were conducted with both the target and control groups and the quantitative data was supplemented by the collection of in-depth interviews with project participants following the qualitative research.
12. A4Labs - Arid African Alluvial Aquifers Labs securing water for development
The "Arid African Alluvial Aquifers Labs" (A4Labs) project conducts action research to find alternative ways of accessing groundwater below dry river bed in semi-arid and arid regons in Africa. It has set up three experimental sites ("living labs") in Ethiopia, Mozambique, and Zimbabwe, where farmers, civil society organisations, knowledge institutes and the private sector co-develop and test innovative approaches to access this ground water and use it for agriculture and socio-economic development. The IMK team supports the implementers in carrying out the impact research, using the Stories of Change methodology, so that they can adapt their interventions to achieve maximum effect. For more information on the project: https://a4labs.un-ihe.org/arid-african-alluvial-aquifers-a4labs
13. Voice Network Evaluation
The subject of this evaluation is the Grand Bargain project (“To contribute to strengthen further the quality of EU humanitarian aid through facilitating dialogue and providing operational expertise to the implementation of the Grand Bargain.”) which was implemented by VOICE from December 2017 until May 2019. The project aimed to contribute to a more inclusive and possibly a more contextualized implementation of the Grand Bargain, by fostering NGOs’ and frontline responders’ engagement in the Grand Bargain. The project was implemented both in the EU and in the field with workshops in Somalia, DR Congo (DRC) & Lebanon. It was led by the VOICE network and supported by a Grand Bargain taskforce with 18 members. The project was funded by DGD Humanitaire at the Belgian Ministry of Foreign Affairs. This evaluation was conducted jointly by Oxfam Belgium and IMK.
14. Supporting Agricultural Productivity in Burundi (PAPAB)
The PAPAB project by Oxfam Novib, Wageningen Environmental Research, IFDC, and ZOA, aims to sustainably increase food production in six provinces in Burundi. It does so in two ways. First, through a reform of the fertilizer subsidy system to improve farmers’ access to fertilizer. Second, through the PIP (Plan Intégré du Paysan)approach: each family’s shared vision of future integrated planning will increase a farmer’s motivation to change the current reality. We carried out a qualitative analysis of the impact the project has on the intrinsic motivation of farmers. The topic had hardly been evaluated before in development projects, this is how we did it. For more information on the project: https://www.wur.nl/en/project/Supporting-Agricultural-Productivity-in-Burundi-PAPAB.htm
15. Voice ENPower: Entries of the Empowered
Voice is a grant facility that supports the most marginalised and discriminated groups, for example people living with disabilities, LGBTI people, and ethnic minorities.Together with the Voice programme team, IMK has implemented the research project “Entries of the Empowered”. In this project, people keep a regular audio diary of events, focusing on the challenges they face and the factors that help and hinder them to overcome these challenges, become empowered and raise their voice. The diaries provide insights into the experiences of marginalised groups and give them the freedom to share whatever they wish to share. The process of keeping a diary can also be empowering in itself, as it can for example can help people reflect on and learn from their individual strategies. The overall objective of the research is to promote learning about marginalised groups, so that strategies to address issues that affect them can be improved.