1. Health Program Evaluation: Is It Worth It?
Growth of Health Program Evaluation
Types of Health Program Evaluation
2. The Evaluation Process as a Three-Act Play
Evaluation as a Three-Act Play
Evaluation in a Cultural Context
Act I: Asking the Question
3. Developing Evaluation Questions
Step 1: Specify Program Theory
Step 2: Specify Program Objectives
Step 3: Translate Program Theory and Objectives Into Evaluation Questions
Step 4: Select Key Questions
Act II: Answering the Question; Scene 1: Developing the Evaluation Design to Answer the Questions
4. Evaluation of Program Impacts
Quasi-Experimental Study Designs
Counterfactuals and Experimental Study Designs
Statistical Threats to Validity
Generalizability of Impact Evaluation Results
Evaluation of Impact Designs and Meta-Analysis
5. Cost-Effectiveness Analysis
Cost-Effectiveness Analysis: An Aid to Decision Making
Comparing Program Costs and Effects: The Cost-Effectiveness Ratio
Types of Cost-Effectiveness Analysis
Steps in Conducting a Cost-Effectiveness Analysis
Evaluation of Program Effects and Costs
6. Evaluation of Program Implementation
Types of Evaluation Designs for Answering Implementation Questions
Types of Implementation Questions and Designs for Answering Them
Act II: Answering the Question; Scenes 2 and 3: Developing the Methods to Carry Out the Design and Conducting the Evaluation
7. Population and Sampling
Step 1: Identify the Target Populations of the Evaluation
Step 2: Identify the Eligible Members of Each Target Population
Step 3: Decide Whether Probability of Nonprobability Sampling is Necessary
Step 4: Choose a Nonprobability Sampling Design for Answering an Evaluation Question
Step 5: Choose a Probability Sampling Design Answering an Evaluation Question
Step 6: Determine Minimum Sample Size Requirements
Step 7: Select the Sample
8. Measurement and Data Collection
Measurement and Data Collection in Quantitative Evaluations
Data Collection in Qualitative Evaluations
Reliability and Validity in Qualitative Evaluations
Management of Data Collection
9. Data Analysis
Getting Started: What's the Question?
Qualitative Data Analysis
Quantitative Data Analysis
Act III: Using the Answers in Decision Making
10. Disseminating the Answers to Evaluation Questions
Scene 1: Translating Evaluation Answers Back Into Policy Language
Scene 2: Developing a Dissemination Plan for Evaluation Answers
Scene 3: Using the Answers in Decision Making and the Policy Cycle
How Answers Are Used by Decision Makers
11. Epilogue