Critical instance : This examines a single instance of unique interest, or serves as a critical test of an assertion about a program, problem or strategy. Program implementation. This investigates operations, often at several sites, and often with reference to a set of norms or standards about implementation processes.
Program effects. This examines the causal links between the program and observed effects outputs, outcomes or impacts, depending on the timing of the evaluation and usually involves multisite, multimethod evaluations. This brings together findings from many case studies to answer evaluative questions. The following guides are particularly recommended because they distinguish between the research design case study and the type of data qualitative or quantitative , and provide guidance on selecting cases, addressing causal inference, and generalizing from cases.
A case study is particularly useful for evaluating programs when programs are unique, when an established program is implemented in a new setting, when a unique outcome warrants further investigation, or when a program occurs in an unpredictable environment.
Login Login and comment as BetterEvaluation member or simply fill out the fields below. Resources Guides The following guides are particularly recommended because they distinguish between the research design case study and the type of data qualitative or quantitative , and provide guidance on selecting cases, addressing causal inference, and generalizing from cases.
Case Study Evaluation : This guide from the US General Accounting Office outlines good practice in case study evaluation and establishes a set of principles for applying case studies to evaluations. What is working, and what is not? The immediate results of conducting a Success Case Method study include documented stories of impact that can be disseminated to stakeholders, and a better knowledge of factors that enhance or impede business impact.
The program provided training and support to a small number of professionals who were placed in new positions within government departments. The objectives for using this method were to support the donor and implementer to adaptively manage the project and to discover the, as yet unknown, development pathways from the project activities to the desired outcomes.
The trial surfaced several key lessons that are applicable for those considering using this approach. You can read Liz's reflections on the challenges encountered and the results here: Lessons from a trial of the Success Case Method.
The Success Case Method: A Simple Evaluation Tool to Identify Critical Success Factors and Program Impact: Identification and reporting of critical success factors and program impact in an efficient, yet comprehensive manner is an inherent difficulty facing many evaluators of large-scale evaluations. This paper details how two evaluators encountered such problems in the initial review of a large-scale initiative and then successfully addressed these issues through the application of the Success Case Method in a subsequent evaluation of the same program.
It includes suggestions for pairing the approach with other methods. Evaluating with the Success Case Method : This post discusses the author's use of SCM as compared to the Kirkpatrick evaluation model for evaluating learning.
Adding a Time-Series Design Element to the Success Case Method to Improve Methodological Rigor: This method note demonstrates how SCM was modified and extended to a social service context, in which the program evaluated was aimed at reducing chronic homelessness and unemployment.
Peering inside the clock: Using success case method to determine how and why practice-based educational interventions succeed: This study employed Success Case Method to understand how 3 performance improvement CME activities contributed to implementation of tobacco cessation practice guidelines in 9 outpatient practices.
Brinkerhoff, R. Will the evaluation provide relevant useful information in a timely manner? Are the planned evaluation activities realistic given the time, resources, and expertise at hand? Accuracy Ensures that the evaluation revealsEnsures that the evaluation reveals and conveys technically accurateand conveys technically accurate information.
Will the evaluation produce findings that Will the evaluation produce findings that are valid and reliable, given the needs ofare valid and reliable, given the needs of those who will use the results?
When to conduct a Prog Evaluation? Managing through the project life cycle The log frame is a way of structuring the main elements in a project and highlighting the logical linkages between them. Logic — up and across Log Frame — Filling the matrix Log Frame — Filling the matrix e.
Health workers apply the training AND Assessment of assumptions How do we plan an Impact Evaluation? Those are: 1. Is IE the best way to answer the question about the program?
What are the key evaluation questions? Who will be involved in making decisions and how will the evaluation process be managed? Cost Effectiveness analysis CEA 2. Cost-Utility analysis CUA 3. Cost-Benefit analysis CBA Measurement of costs and consequences in economic evaluation What all can we Evaluate?
Provide affordable, high quality health care through effective partnerships at the village level; 2. Build the capacity of coalitions of local partners to sustain child survival activities and health gains; 3. Refine and test a social franchising model for the delivery of child survival interventions; and 4.
Document, disseminate and share key program lessons and results to facilitate adaptation, replication and policy advocacy. To sum up.. To sum up This will help to decide how best to carry out the evaluation. Introduction to program evaluation for public health programs: A self-study guide.
Atlanta, GA: Oct Impact Evaluation in Practice. The World Bank. Washington DC; Burlington MA; Oxford University Press. United Kingdom; Handbook on impact evaluation: Quantitative methods and practices. The World bank. Washington D. Technical Note. The logical framework.
0コメント