Exploring How Program Community Members Are Engaged in Evaluation Projects
type: CreativeWork
description: This dissertation explored how evaluators engage program community members in their evaluation projects. While there are ongoing debates on its efficacy, evaluation engagement is a widely discussed topic among evaluation practitioners and scholars. However, despite the growth in the literature surrounding engaging program community members in evaluation, there is a need for more methodologically rigorous studies of the topic (Brandon & Fukunaga, 2014). This dissertation seeks to address this gap by investigating why, who, when, and how program community members are engaged in the evaluation process, as well as the competencies, challenges, and strategies that evaluators associate with the engagement. It utilized a mixed-methods design, combining qualitative and quantitative approaches to gain a comprehensive understanding of program community engagement in evaluations. The study had two phases; the first was primarily qualitative and involved interviewing ten experts in evaluation engagement. The findings from the first phase were instrumental in designing the primarily quantitative survey in the second phase that was administered to a representative sample of 118 members of the American Evaluation Association. The findings reveal that engaging program community members in evaluations is common, but manifests differently in terms of reasons, extent, control, challenges, and strategy based on the context of the evaluation and characteristics of the evaluator. Key findings included that engagement and control by program community members followed a W-shaped pattern—declining slightly after initial stages, rising during data collection, dropping sharply during analysis, then increasing again in later phases like dissemination and use. Additionally, the findings demonstrated that program decision makers had the highest extent and control of engagement followed by program staff, then other interested parties such as government officials, and lowest extent and control for…
abstract: This dissertation explored how evaluators engage program community members in their evaluation projects. While there are ongoing debates on its efficacy, evaluation engagement is a widely discussed topic among evaluation practitioners and scholars. However, despite the growth in the literature surrounding engaging program community members in evaluation, there is a need for more methodologically rigorous studies of the topic (Brandon & Fukunaga, 2014). This dissertation seeks to address this gap by investigating why, who, when, and how program community members are engaged in the evaluation process, as well as the competencies, challenges, and strategies that evaluators associate with the engagement. It utilized a mixed-methods design, combining qualitative and quantitative approaches to gain a comprehensive understanding of program community engagement in evaluations. The study had two phases; the first was primarily qualitative and involved interviewing ten experts in evaluation engagement. The findings from the first phase were instrumental in designing the primarily quantitative survey in the second phase that was administered to a representative sample of 118 members of the American Evaluation Association. The findings reveal that engaging program community members in evaluations is common, but manifests differently in terms of reasons, extent, control, challenges, and strategy based on the context of the evaluation and characteristics of the evaluator. Key findings included that engagement and control by program community members followed a W-shaped pattern—declining slightly after initial stages, rising during data collection, dropping sharply during analysis, then increasing again in later phases like dissemination and use. Additionally, the findings demonstrated that program decision makers had the highest extent and control of engagement followed by program staff, then other interested parties such as government officials, and lowest extent and control for…
author: Mwirigi, Mike Osiemo
keywords: Evaluation engagement, Practical Participatory Evaluation, Program community members, American Evaluation Association, Psychology
date published: 2025-01-01T08:00:00Z
date modified: 2026-07-24T01:41:17Z
provider: Claremont Graduate University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Claremont Graduate University