{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/34544"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/34544","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"An examination of the practice of culturally responsive evaluation: a case study of the Girls Adventures in Mathematics, Engineering, and Science (G.A.M.E.S.) summer camp at the University of Illinois","abstract":"In recent decades, there has been an expansion of evaluation approaches that seek to respond to the cultural context of the program that is being evaluated. Of these, culturally responsive evaluation is the most well-known evaluation approach. The purpose of culturally responsive evaluation is to take into account the cultural context of the program in the evaluation. To do so, it incorporates the culture of the program and participants throughout the evaluation process: preparation, design, and implementation. This instrumental case study examines how a culturally responsive evaluation approach was applied to evaluate a Science, Technology, Engineering, and Mathematics (STEM) program. More specifically, it highlights the specific culturally responsive evaluation strategies that were employed throughout the evaluation process. Further, it highlights the strengths and challenges associated with a culturally responsive evaluation approach. The results of the present study support the future use of culturally responsive evaluation approach. While challenges common to culturally responsive evaluation were evident in the study, the strengths were certainly outweighed by the challenges. First, stakeholder engagement increased the overall credibility of the evaluation. For example, the input and advice of the program staff on the evaluation increased the quality of the design of the evaluation and generated evaluation results that were useful and meaningful to program staff and participants. Secondly, a culturally diverse evaluation team increased the validity of the evaluation through the use of shared lived experiences which allowed for the accurate collection, analysis, and interpretation of evaluation findings. Thirdly, a robust evaluation design (mixed methods) that was inclusive of culturally responsive evaluation instruments, analysis, and interpretation also increased the validity of the overall evaluation and results. Further, analysis of data from a culturally responsive evaluation lens provided for the accurate depiction of the experiences of the participants, and in some cases revealed cultural differences that were addressed important to the evaluation’s purpose. The present study is significant in that it adds to the current body of literature on culturally responsive evaluation. In addition, it calls for additional strategies and guidelines for conducting culturally responsive evaluation strategies in order to increase the practice of culturally responsive evaluation both domestically and internationally.","abstract_html":"In recent decades, there has been an expansion of evaluation approaches that seek to respond to the cultural context of the program that is being evaluated. Of these, culturally responsive evaluation is the most well-known evaluation approach. The purpose of culturally responsive evaluation is to take into account the cultural context of the program in the evaluation. To do so, it incorporates the culture of the program and participants throughout the evaluation process: preparation, design, and implementation. This instrumental case study examines how a culturally responsive evaluation approach was applied to evaluate a Science, Technology, Engineering, and Mathematics (STEM) program. More specifically, it highlights the specific culturally responsive evaluation strategies that were employed throughout the evaluation process. Further, it highlights the strengths and challenges associated with a culturally responsive evaluation approach. The results of the present study support the future use of culturally responsive evaluation approach. While challenges common to culturally responsive evaluation were evident in the study, the strengths were certainly outweighed by the challenges. First, stakeholder engagement increased the overall credibility of the evaluation. For example, the input and advice of the program staff on the evaluation increased the quality of the design of the evaluation and generated evaluation results that were useful and meaningful to program staff and participants. Secondly, a culturally diverse evaluation team increased the validity of the evaluation through the use of shared lived experiences which allowed for the accurate collection, analysis, and interpretation of evaluation findings. Thirdly, a robust evaluation design (mixed methods) that was inclusive of culturally responsive evaluation instruments, analysis, and interpretation also increased the validity of the overall evaluation and results. Further, analysis of data from a culturally responsive evaluation lens provided for the accurate depiction of the experiences of the participants, and in some cases revealed cultural differences that were addressed important to the evaluation’s purpose. The present study is significant in that it adds to the current body of literature on culturally responsive evaluation. In addition, it calls for additional strategies and guidelines for conducting culturally responsive evaluation strategies in order to increase the practice of culturally responsive evaluation both domestically and internationally.","abstract_has_math":false,"creators":["Jimenez, Maria"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Educational Policy Studies","degree_department":null,"school":null,"contributors":["DeStefano, Lizanne","Anderson, James D.","Hood, Stafford","Trent, William T."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2012,"date_issued":"2012-09-18T21:24:58Z","date_published":"2012-09-18T21:24:58Z","updated_at":"2026-07-22T22:25:31Z","subjects":["educational evaluation and policy","Science, Technology, Engineering, and Mathematics (STEM) evaluation"],"languages":["en"],"rights":["Copyright 2012 Maria Jimenez"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/34544","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["DeStefano, Lizanne","Anderson, James D.","Hood, Stafford","Trent, William T."]},{"key":"dc:creator","label":"Author","values":["Jimenez, Maria"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2012-09-18T21:24:58Z","2014-09-18T10:00:36Z","2012-08"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Educational Policy Studies"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["educational evaluation and policy","Science, Technology, Engineering, and Mathematics (STEM) evaluation"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2012 Maria Jimenez"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/34544"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In recent decades, there has been an expansion of evaluation approaches that seek to respond to the cultural context of the program that is being evaluated. Of these, culturally responsive evaluation is the most well-known evaluation approach. The purpose of culturally responsive evaluation is to take into account the cultural context of the program in the evaluation. To do so, it incorporates the culture of the program and participants throughout the evaluation process: preparation, design, and implementation. This instrumental case study examines how a culturally responsive evaluation approach was applied to evaluate a Science, Technology, Engineering, and Mathematics (STEM) program. More specifically, it highlights the specific culturally responsive evaluation strategies that were employed throughout the evaluation process. Further, it highlights the strengths and challenges associated with a culturally responsive evaluation approach. The results of the present study support the future use of culturally responsive evaluation approach. While challenges common to culturally responsive evaluation were evident in the study, the strengths were certainly outweighed by the challenges. First, stakeholder engagement increased the overall credibility of the evaluation. For example, the input and advice of the program staff on the evaluation increased the quality of the design of the evaluation and generated evaluation results that were useful and meaningful to program staff and participants. Secondly, a culturally diverse evaluation team increased the validity of the evaluation through the use of shared lived experiences which allowed for the accurate collection, analysis, and interpretation of evaluation findings. Thirdly, a robust evaluation design (mixed methods) that was inclusive of culturally responsive evaluation instruments, analysis, and interpretation also increased the validity of the overall evaluation and results. Further, analysis of data from a culturally responsive evaluation lens provided for the accurate depiction of the experiences of the participants, and in some cases revealed cultural differences that were addressed important to the evaluation’s purpose. The present study is significant in that it adds to the current body of literature on culturally responsive evaluation. In addition, it calls for additional strategies and guidelines for conducting culturally responsive evaluation strategies in order to increase the practice of culturally responsive evaluation both domestically and internationally.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-12T17:19:55Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 3 Jimenez_Maria.pdf: 1631888 bytes, checksum: 2d9daec6b413088bdea8ff83d7512754 (MD5) Jimenez_Maria.pdf: 1632209 bytes, checksum: 79eef03d53f8bce66a2a1025bc0104e5 (MD5) Jimenez_Maria.pdf: 1631888 bytes, checksum: 2d9daec6b413088bdea8ff83d7512754 (MD5)","Made available in DSpace on 2012-09-18T21:24:58Z (GMT). No. of bitstreams: 2 Jimenez_Maria.pdf: 1630462 bytes, checksum: f0eb9c3629a85b5a46e8ff0825bcb1e4 (MD5) license.txt: 4063 bytes, checksum: cccf2970a14378f979992123b381042a (MD5)","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:25Z Item is restricted until 2014-09-18T21:27:16Z","Restriction data tranferred 2014-07-01T11:35:46-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 34818 on 2014-09-18T10:00:36Z."]},{"key":"dc:title","label":"Title","values":["An examination of the practice of culturally responsive evaluation: a case study of the Girls Adventures in Mathematics, Engineering, and Science (G.A.M.E.S.) summer camp at the University of Illinois"]}]}],"canonical_facts":{"dc:contributor":["DeStefano, Lizanne","Anderson, James D.","Hood, Stafford","Trent, William T."],"dc:creator":["Jimenez, Maria"],"dc:date":["2012-09-18T21:24:58Z","2014-09-18T10:00:36Z","2012-08"],"dc:description":["In recent decades, there has been an expansion of evaluation approaches that seek to respond to the cultural context of the program that is being evaluated. Of these, culturally responsive evaluation is the most well-known evaluation approach. The purpose of culturally responsive evaluation is to take into account the cultural context of the program in the evaluation. To do so, it incorporates the culture of the program and participants throughout the evaluation process: preparation, design, and implementation. This instrumental case study examines how a culturally responsive evaluation approach was applied to evaluate a Science, Technology, Engineering, and Mathematics (STEM) program. More specifically, it highlights the specific culturally responsive evaluation strategies that were employed throughout the evaluation process. Further, it highlights the strengths and challenges associated with a culturally responsive evaluation approach. The results of the present study support the future use of culturally responsive evaluation approach. While challenges common to culturally responsive evaluation were evident in the study, the strengths were certainly outweighed by the challenges. First, stakeholder engagement increased the overall credibility of the evaluation. For example, the input and advice of the program staff on the evaluation increased the quality of the design of the evaluation and generated evaluation results that were useful and meaningful to program staff and participants. Secondly, a culturally diverse evaluation team increased the validity of the evaluation through the use of shared lived experiences which allowed for the accurate collection, analysis, and interpretation of evaluation findings. Thirdly, a robust evaluation design (mixed methods) that was inclusive of culturally responsive evaluation instruments, analysis, and interpretation also increased the validity of the overall evaluation and results. Further, analysis of data from a culturally responsive evaluation lens provided for the accurate depiction of the experiences of the participants, and in some cases revealed cultural differences that were addressed important to the evaluation’s purpose. The present study is significant in that it adds to the current body of literature on culturally responsive evaluation. In addition, it calls for additional strategies and guidelines for conducting culturally responsive evaluation strategies in order to increase the practice of culturally responsive evaluation both domestically and internationally.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-12T17:19:55Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 3 Jimenez_Maria.pdf: 1631888 bytes, checksum: 2d9daec6b413088bdea8ff83d7512754 (MD5) Jimenez_Maria.pdf: 1632209 bytes, checksum: 79eef03d53f8bce66a2a1025bc0104e5 (MD5) Jimenez_Maria.pdf: 1631888 bytes, checksum: 2d9daec6b413088bdea8ff83d7512754 (MD5)","Made available in DSpace on 2012-09-18T21:24:58Z (GMT). No. of bitstreams: 2 Jimenez_Maria.pdf: 1630462 bytes, checksum: f0eb9c3629a85b5a46e8ff0825bcb1e4 (MD5) license.txt: 4063 bytes, checksum: cccf2970a14378f979992123b381042a (MD5)","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:25Z Item is restricted until 2014-09-18T21:27:16Z","Restriction data tranferred 2014-07-01T11:35:46-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 34818 on 2014-09-18T10:00:36Z."],"dc:identifier":["http://hdl.handle.net/2142/34544"],"dc:language":["en"],"dc:rights":["Copyright 2012 Maria Jimenez"],"dc:subject":["educational evaluation and policy","Science, Technology, Engineering, and Mathematics (STEM) evaluation"],"dc:title":["An examination of the practice of culturally responsive evaluation: a case study of the Girls Adventures in Mathematics, Engineering, and Science (G.A.M.E.S.) summer camp at the University of Illinois"],"thesis:degree_discipline":["Educational Policy Studies"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:31Z"}