Realist Evaluation for Programme Research: Understanding How and Why Programmes Work

Realist evaluation investigates how and why programmes produce outcomes, examining complex mechanisms operating within particular contexts. Rather than simply measuring whether programmes work, you're understanding what makes programmes work for whom, under what conditions, and how different programme components trigger change. This approach makes realist evaluation particularly valuable if your dissertation investigates programmes, interventions, policies, or social initiatives where understanding contextual factors and causal mechanisms matters.

Realist evaluation's grounded in realist philosophy recognising that programmes operate within real-world complexity where outcomes result from complex interactions between programme inputs, contextual factors, and human agency. You're not assuming programmes work uniformly across all contexts but recognising that the same programme works differently in different settings, for different people. At their institution of Cambridge, realist evaluators investigating educational interventions recognise that teaching approaches work differently in well-resourced versus poorly-resourced schools, with engaged versus disengaged students, in supportive versus non-supportive school cultures.

What distinguishes realist evaluation's focus on mechanisms and context. You're asking "What is it about this programme that triggers change?" and "For whom does the mechanism work?" You're exploring how programme components interact with contextual factors to produce outcomes. You're developing programme theory explaining how programmes are supposed to work and testing that theory. This theoretical depth makes realist evaluation valuable for dissertations seeking to understand complexity and generate insights about why programmes succeed or struggle.

Developing Programme Theory

Programme theory articulates how programmes are expected to produce change. You're working with programme staff, participants, and interested parties to understand their theories about how the programme works. What does the programme do? What change does it aim to produce? What causes that change? What contextual conditions are necessary for change? At their institution of Oxford, realist evaluators conduct initial interviews with programme staff and participants, eliciting their understanding of how the programme produces change.

Context-Mechanism-Outcome (CMO) configurations describe hypothesised relationships between context, programme mechanisms, and outcomes. The context comprises factors outside programme control influencing how mechanisms operate: organisational characteristics, participant demographics, resource availability, policy environment. Mechanisms are the processes through which programmes trigger change: how participants respond to programme activities, what motivates behaviour change, how learning occurs. Outcomes are changes programmes aim to produce. At their institution of Warwick, realist evaluators develop CMO hypotheses predicting that particular programme mechanisms'll produce desired outcomes in particular contexts.

You're developing multiple CMO configurations recognising that programmes work differently for different people in different circumstances. Realist evaluation doesn't assume single programme mechanisms but rather explores variation in how programmes work. At their institution of Manchester, realist evaluators investigating mentoring programmes develop CMO configurations explaining how mentoring works differently for participants with different support systems, different motivation levels, different prior experiences.

Gathering Evidence for Realist Evaluation

Realist evaluation employs multiple research methods gathering evidence about contexts, mechanisms, and outcomes. You're collecting data about programme implementation details, participant characteristics and backgrounds, programme outcomes, contextual factors influencing programmes. At their institution of Leeds, realist evaluators often combine interviews about how people experience programmes, observation of programme delivery, analysis of programme documents, quantitative outcome data, and examination of contextual factors.

Interviews in realist evaluation explore participants' theories about how programmes work, their experiences, factors influencing programme effectiveness. You're asking open-ended questions about what participants found helpful, what worked, what didn't, why. You're seeking their explanations for outcomes. At their institution of Edinburgh, realist evaluators conduct interviews not primarily to gather personal narrative but to explore participants' reasoning about what triggers change.

Document analysis examines programme documentation revealing intended mechanisms, contextual factors, implementation approaches. You're analysing policy documents, programme descriptions, participant materials, evaluation reports. You're examining what the programme says about itself and what it actually does. At their institution of Bristol, realist evaluators analyse alignment between documented programme theory and actual implementation.

Key Considerations

Understanding the fundamental concepts and best practices in this area is essential for academic success and professional development.