Evaluation of dZi Foundation’s Deep Development programming 2007-2018
Client:
dZi Foundation
Vitol Foundation
Geography:
Nepal
ServiceS:
Applied research and evaluation
Data analysis, viz, reporting
Program strategy
Capacity Building
SectorS:
Agriculture
Climate change
Education
Health
Livelihoods
WASH
Background
After a decade of partnership, dZi wanted to better understand the impact of their work in communities and identify challenges to inform future programming strategies. Furthermore, dZi’s working areas were rapidly changing in response to the Nepal Government’s decentralization of authority and the empowerment of local administrations, out-migration, and the expansion of rural roads. The evaluation aimed to better understand the impact of these changes and inform the adaptation of the Deep Development programming approach.
What is Deep Development?
Deep development emphasizes listening, learning, and growing in partnership. Applied in practice, dZi Foundation begins working with community by seeking out what makes that remote partner communities special, and what elements of their lives they seek to preserve. Together, the partnership brings to light mutual dreams for the future, creating tangible, measurable goals, and working together to achieve impact. Projects are therefore designed, implemented, and maintained together.
objectives
The evaluation had two main objectives:
Demonstrate the impact of programming from 2007-2019
Examine the current programming approach and identify strengths, challenges, and areas for improvement
Activities
Inception activities: Informed International carried out an interactive inception workshop with dZi program staff to gather perspectives on what would be considered a credible, high quality and useful evaluation. The teams also identified primary users of the evaluation and developed/refined evaluation questions and methods.
Evaluation framework development: Based on the results of the inception workshop, Informed developed the evaluation framework which outlined evaluation questions, indicators, tools, and sampling approach.
Enumerator training: Informed trained 20+ enumerators on data collection tools including the use of Kobo for digital data collection.
Data collection: While enumerators carried out the household survey, Informed staff facilitated Focus Group Discussions in the communities.
Analysis and Sense-Making: Informed did an initial analysis of data and presented findings using Data Placemats for engagement/feedback from the dZi team. This helped the team interpret findings and ensured that analysis was considering their interests.
Reporting and Dissemination: Results were compiled in a variety of formats for dissemination to various people throughout the communities, programming / leadership team members, the board, and donors. The report has been used to inform dZi’s new strategic approach and monitoring and evaluation work.
Journey Map created as part of the exercise to understand dZi’s programming impact. Design: Devin Draudt Sundeen.
Data Placemats used during sense-making workshops:
Note: The complete evaluation report is an internal document.