{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/95325"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/95325","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Understanding and defining situational awareness and interpersonal competence as essential evaluator competencies","abstract":"“What constitutes a competent evaluator?” This question has been a topic of discussion and lively debates within evaluation communities around the world. In the past two decades, numerous evaluation organizations, associations and societies have moved towards developing and using evaluator competency frameworks. Given that multiple frameworks have been developed worldwide, 12 thus far, we are now at a point where it is no longer a question of can evaluator competencies be identified, but how do we move forward with revising, understanding, and using these frameworks not only in practice, but also in the education and training of evaluation. As King and Stevahn (2015) recently noted, “...regardless of who developed [these competency frameworks] or how, it is unlikely that anyone would disagree that they could benefit from additional developmental work” (p. 31). As such, this study aimed to inform and advance this conversation on evaluator competence. In particular, the aim of this study was to examine the meaning of two dimensions of practice, interpersonal competence (IC) and situational awareness (SA), from the perspective of experienced program evaluators. A qualitative research design (Merriam, 2009) utilizing semi-structured interviews was best suited for this study. Based on the responses of 13 interviewed evaluators, five main findings emerged. First, evaluators pointed to three critical aspects of SA which included intentionally learning about a project, attending to the cultural dimensions of an evaluation, and understanding stakeholder perspectives on and expectations for evaluation. Second, evaluators identified two important aspects of IC, including purposefully engaging in ongoing communication with the project being evaluated and mindfully framing and sharing evaluative information. Data analysis also revealed two factors that informed how evaluators discussed these aspects of IC and SA. These factors include evaluators’ 1) professional dispositions and 2) reputation and experiential knowledge. These factors were important to understand because evaluators discussed IC and SA through their professional lenses that were based, in part, on their dispositions and experiences. In closing, implications for evaluation education and training and future research are discussed.","abstract_html":"“What constitutes a competent evaluator?” This question has been a topic of discussion and lively debates within evaluation communities around the world. In the past two decades, numerous evaluation organizations, associations and societies have moved towards developing and using evaluator competency frameworks. Given that multiple frameworks have been developed worldwide, 12 thus far, we are now at a point where it is no longer a question of can evaluator competencies be identified, but how do we move forward with revising, understanding, and using these frameworks not only in practice, but also in the education and training of evaluation. As King and Stevahn (2015) recently noted, “...regardless of who developed [these competency frameworks] or how, it is unlikely that anyone would disagree that they could benefit from additional developmental work” (p. 31). As such, this study aimed to inform and advance this conversation on evaluator competence. In particular, the aim of this study was to examine the meaning of two dimensions of practice, interpersonal competence (IC) and situational awareness (SA), from the perspective of experienced program evaluators. A qualitative research design (Merriam, 2009) utilizing semi-structured interviews was best suited for this study. Based on the responses of 13 interviewed evaluators, five main findings emerged. First, evaluators pointed to three critical aspects of SA which included intentionally learning about a project, attending to the cultural dimensions of an evaluation, and understanding stakeholder perspectives on and expectations for evaluation. Second, evaluators identified two important aspects of IC, including purposefully engaging in ongoing communication with the project being evaluated and mindfully framing and sharing evaluative information. Data analysis also revealed two factors that informed how evaluators discussed these aspects of IC and SA. These factors include evaluators’ 1) professional dispositions and 2) reputation and experiential knowledge. These factors were important to understand because evaluators discussed IC and SA through their professional lenses that were based, in part, on their dispositions and experiences. In closing, implications for evaluation education and training and future research are discussed.","abstract_has_math":false,"creators":["Garcia, Gabriela Liseth"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Educational Psychology","degree_department":null,"school":null,"contributors":["Greene, Jennifer C.","Schwandt, Thomas A.","Stevahn, Laurel A","DeStefano, Lizanne"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-03-01T15:48:50Z","date_published":"2017-03-01T15:48:50Z","updated_at":"2026-07-22T22:26:37Z","subjects":["Situational awareness","Interpersonal competence","Evaluator competency frameworks"],"languages":["en"],"rights":["Copyright 2016 Gabriela Garcia"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/95325","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Greene, Jennifer C.","Schwandt, Thomas A.","Stevahn, Laurel A","DeStefano, Lizanne"]},{"key":"dc:creator","label":"Author","values":["Garcia, Gabriela Liseth"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-03-01T15:48:50Z","2016-11-18","2016-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Educational Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Situational awareness","Interpersonal competence","Evaluator competency frameworks"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2016 Gabriela Garcia"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/95325"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["“What constitutes a competent evaluator?” This question has been a topic of discussion and lively debates within evaluation communities around the world. In the past two decades, numerous evaluation organizations, associations and societies have moved towards developing and using evaluator competency frameworks. Given that multiple frameworks have been developed worldwide, 12 thus far, we are now at a point where it is no longer a question of can evaluator competencies be identified, but how do we move forward with revising, understanding, and using these frameworks not only in practice, but also in the education and training of evaluation. As King and Stevahn (2015) recently noted, “...regardless of who developed [these competency frameworks] or how, it is unlikely that anyone would disagree that they could benefit from additional developmental work” (p. 31). As such, this study aimed to inform and advance this conversation on evaluator competence. In particular, the aim of this study was to examine the meaning of two dimensions of practice, interpersonal competence (IC) and situational awareness (SA), from the perspective of experienced program evaluators. A qualitative research design (Merriam, 2009) utilizing semi-structured interviews was best suited for this study. Based on the responses of 13 interviewed evaluators, five main findings emerged. First, evaluators pointed to three critical aspects of SA which included intentionally learning about a project, attending to the cultural dimensions of an evaluation, and understanding stakeholder perspectives on and expectations for evaluation. Second, evaluators identified two important aspects of IC, including purposefully engaging in ongoing communication with the project being evaluated and mindfully framing and sharing evaluative information. Data analysis also revealed two factors that informed how evaluators discussed these aspects of IC and SA. These factors include evaluators’ 1) professional dispositions and 2) reputation and experiential knowledge. These factors were important to understand because evaluators discussed IC and SA through their professional lenses that were based, in part, on their dispositions and experiences. In closing, implications for evaluation education and training and future research are discussed.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-02-28 without embargo terms","The student, Gabriela Garcia, accepted the attached license on 2016-11-16 at 21:27.","The student, Gabriela Garcia, submitted this Dissertation for approval on 2016-11-16 at 21:28.","This Dissertation was approved for publication on 2016-11-18 at 11:18.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10260 on 2017-02-28 at 14:48:56","Made available in DSpace on 2017-03-01T15:48:50Z (GMT). No. of bitstreams: 3 GARCIA-DISSERTATION-2016.pdf: 1460964 bytes, checksum: 2f77c2d92437b64638f18e47e403fc1f (MD5) LICENSE.txt: 4212 bytes, checksum: 331bb7a9d07c4aeef9b618b677ed32d0 (MD5) PROQUEST_LICENSE.txt: 4558 bytes, checksum: 7b362d7bfdea6dceea2540edd9c8176f (MD5) Previous issue date: 2016-11-18"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Understanding and defining situational awareness and interpersonal competence as essential evaluator competencies"]}]}],"canonical_facts":{"dc:contributor":["Greene, Jennifer C.","Schwandt, Thomas A.","Stevahn, Laurel A","DeStefano, Lizanne"],"dc:creator":["Garcia, Gabriela Liseth"],"dc:date":["2017-03-01T15:48:50Z","2016-11-18","2016-12"],"dc:description":["“What constitutes a competent evaluator?” This question has been a topic of discussion and lively debates within evaluation communities around the world. In the past two decades, numerous evaluation organizations, associations and societies have moved towards developing and using evaluator competency frameworks. Given that multiple frameworks have been developed worldwide, 12 thus far, we are now at a point where it is no longer a question of can evaluator competencies be identified, but how do we move forward with revising, understanding, and using these frameworks not only in practice, but also in the education and training of evaluation. As King and Stevahn (2015) recently noted, “...regardless of who developed [these competency frameworks] or how, it is unlikely that anyone would disagree that they could benefit from additional developmental work” (p. 31). As such, this study aimed to inform and advance this conversation on evaluator competence. In particular, the aim of this study was to examine the meaning of two dimensions of practice, interpersonal competence (IC) and situational awareness (SA), from the perspective of experienced program evaluators. A qualitative research design (Merriam, 2009) utilizing semi-structured interviews was best suited for this study. Based on the responses of 13 interviewed evaluators, five main findings emerged. First, evaluators pointed to three critical aspects of SA which included intentionally learning about a project, attending to the cultural dimensions of an evaluation, and understanding stakeholder perspectives on and expectations for evaluation. Second, evaluators identified two important aspects of IC, including purposefully engaging in ongoing communication with the project being evaluated and mindfully framing and sharing evaluative information. Data analysis also revealed two factors that informed how evaluators discussed these aspects of IC and SA. These factors include evaluators’ 1) professional dispositions and 2) reputation and experiential knowledge. These factors were important to understand because evaluators discussed IC and SA through their professional lenses that were based, in part, on their dispositions and experiences. In closing, implications for evaluation education and training and future research are discussed.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-02-28 without embargo terms","The student, Gabriela Garcia, accepted the attached license on 2016-11-16 at 21:27.","The student, Gabriela Garcia, submitted this Dissertation for approval on 2016-11-16 at 21:28.","This Dissertation was approved for publication on 2016-11-18 at 11:18.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10260 on 2017-02-28 at 14:48:56","Made available in DSpace on 2017-03-01T15:48:50Z (GMT). No. of bitstreams: 3 GARCIA-DISSERTATION-2016.pdf: 1460964 bytes, checksum: 2f77c2d92437b64638f18e47e403fc1f (MD5) LICENSE.txt: 4212 bytes, checksum: 331bb7a9d07c4aeef9b618b677ed32d0 (MD5) PROQUEST_LICENSE.txt: 4558 bytes, checksum: 7b362d7bfdea6dceea2540edd9c8176f (MD5) Previous issue date: 2016-11-18"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/95325"],"dc:language":["en"],"dc:rights":["Copyright 2016 Gabriela Garcia"],"dc:subject":["Situational awareness","Interpersonal competence","Evaluator competency frameworks"],"dc:title":["Understanding and defining situational awareness and interpersonal competence as essential evaluator competencies"],"dc:type":["text"],"thesis:degree_discipline":["Educational Psychology"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:37Z"}