I-a: Impact Evaluation. Assessing causal effects with qualitative data: an introduction to small n impact evaluation.

workshop pitch

description

Are we making a difference? Are the interventions supported by governments, NGOs and other development agencies improving lives?  There has been a rise in the use of impact evaluations which assess the causal effects of interventions in the last 25 years.  There are a range of methods available to evaluators to assess these effects. These can be divided into large n, quantitative methods and small n, qualitative methods. This workshop is about small n methods.  Specifically, contribution analysis, process tracing, outcome harvesting, and qualitative comparative analysis (QCA) will be covered.

The workshop follows a participatory experiential learning approach. Participants are organized into small groups which allows all to contribute their own knowledge and experience.  Regular group exchanges create a participatory learning experience. In each exercise the groups will work on an intervention they select at the beginning of the workshop.

We will begin by discussing the problem of “methods-free” evaluation making inappropriate evidence claims. We next discuss the choice of evaluation approach depending on the nature of the intervention and the underlying causal mechanism. Next, we explore how the theory of change helps shape the evaluation design: what data we need and how we should analyze them.

With the use of case studies, the workshop will outline each of the small and middle n approaches being considered. Participants work with curated datasets to apply and compare the approaches.

The strengths and limitations of each approach will be considered.  Common sources of bias in small n approaches are explored and how to avoid them. Participants will apply a checklist to assess possible biases in selected case studies.

At the end of the workshop participants will be familiar with a range of small n approaches and how to use them, how to avoid possible biases, and have made new friends and colleagues.

objectives

The participants will

• Understand when and how to use contribution analysis, process tracing, outcome harvesting and qualitative comparative analysis (QCA)
• Have a stronger understanding of the basics of evaluation design
• Be aware of possible sources of bias in small n and other evaluations and how to avoid them
• Established a network of colleagues

recommended for

This workshop is primarily intended for evaluators. However, it will also be of use to evaluation commissioners and users of evaluation findings.  Evaluators and commissioners will learn about the appropriate evaluation approach for different interventions. Users will learn what different types of evaluation can tell them. All will learn to look out for possible biases in evaluations.

level

The workshop is mid-level. Participants should have some familiarity with the evaluation field (i.e. types of evaluation, principles of evaluation, uses of evaluation) and with social science research methodology. No knowledge of any software is required.

prerequisites

There are no prerequisites.

>> Apply here <<

How to apply in 2 Steps:

1. Create an account or log in here
2. Under “My IPDET” please follow “APPLY FOR THE PROGRAM”

Booking possible only as long as seats are available!