An Empirical Examination And Metaevaluation Of The Impact Evaluation Process

<p>This dissertation empirically examines the Guerra-Lopez (2007a) Impact Evaluation Process (IEP), which is a prescriptive program evaluation model. Since there is no generally accepted process for arriving at final judgments about the usefulness, appropriateness, effectiveness, reliability, and validity of evaluation models, this study used a combination of approaches to begin to build a body of evidence about the effectiveness of the IEP. Primarily, the study used Stufflebeam's (2011) recently revised Program Evaluations Metaevaluation Checklist to examine the model. The Checklist is based on the Joint Committee on Standards for Educational Evaluation's (2010) Program Evaluation Standards. Fitzpatrick, Sanders, & Worthen (2011) recommend selecting a subset of these standards to use when evaluation a design. Additionally, the study used Miller's (2010) framework for empirically evaluating how evaluation theory informs practice. First, through a study of three evaluation theory classification schemes, the researcher identifies where the IEP fits among other common evaluation models. Next, in order to reach a judgment based on the model's application in the real world, the researcher conducted an impact evaluation on a 1:1 technology program at a secondary school using the model. The process used to conduct the evaluation is discussed in detail. As part of the process, the researcher developed an operationalized version of the model. Based on these standards and Stufflebeam's (2011) Checklist scoring method, the evaluator and a professional metaevaluator rated the Impact Evaluation Process as "Very Good".</p>

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Open Access Dissertation

Discipline thesis:degree_discipline

Instructional Technology

Year dc:date.available

2013

Author dc:creator

• Blake, Anne Maechling

Contributors dc:contributor

• James L. Moseley

• evaluation
• instructional technology
• metaevaluation
• performance improvement
• Educational Assessment, Evaluation, and Research
• Other Education

Repository record dc:identifier

https://digitalcommons.wayne.edu/oa_dissertations/640

OAI identifier oai:identifier

oai:digitalcommons.wayne.edu:oa_dissertations-1639