{"id":{"repo_id":"claremont","oai_identifier":"oai:scholarship.claremont.edu:cgu_etd-1814"},"canonical_url":"https://search.dev.ndltd.org/etd/claremont/oai:scholarship.claremont.edu:cgu_etd-1814","repository":{"repo_id":"claremont","name":"Claremont Graduate University","base_url":"https://scholarship.claremont.edu/do/oai/"},"display":{"title":"Exploring Pupil-Perceptions of Computer-Mediated Standardized Assessments","abstract":"<p>This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other states, at four different settings in one local unified high school district. The study was then paused for two years to allow for fuller implementation of SBAC. Then, in 2017, the study resumed at the original research settings plus one more with the goal of capturing any significant qualitative data insights into a new group of participants’ SBAC experiences. The study was then paused for a second time to allow for some preliminary data analyses and reflection. Finally, in 2022, the study resumed after adopting and then practicing COVID protocols with a third group of participants at three of the previous five research settings. These punctuated data-collection periods afforded comparative analyses of students’ computer-mediated test-taking experiences, which were phenomena not documented in the known literature about the initial year of SBAC. As such, the singular research question of this study, i.e., what were high school juniors’ experiences while taking Smarter Balanced Summative Assessments? spurred phenomenological explorations via focus group and individual interviews of a total of 90 participants in-person and via Zoom platform. Subsequently, using MAXQDA Analytics Pro 2024 software, analyses of the three years of data resulted in four critical findings: (1.) Poor incentive structures and unclear reasons why students needed to take SBAC contributed to participants’ lackluster motivation to perform to the best of their abilities on SBAC; (2.) Problematic SBAC content language contributed to students’ frustrations and extraneous cognitive load; (3.) Limited formal computer literacy skills stunted students’ abilities to understand and manipulate SBAC’s logics of semantic and visual discourse designs; and (4.) Time-sensitive affordances of some SBAC tools and design features restricted test-takers from keeping virtual records of their participations within sections and between sections of the same test. These findings signaled five limitations of this study and yielded five recommendations for practice, especially concerning optimal instructional designs tailored for standardized testing preparatory content to be delivered via instructional technology, and the advantages of doing so for student motivation and performance.</p>","abstract_html":"&lt;p&gt;This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other states, at four different settings in one local unified high school district. The study was then paused for two years to allow for fuller implementation of SBAC. Then, in 2017, the study resumed at the original research settings plus one more with the goal of capturing any significant qualitative data insights into a new group of participants’ SBAC experiences. The study was then paused for a second time to allow for some preliminary data analyses and reflection. Finally, in 2022, the study resumed after adopting and then practicing COVID protocols with a third group of participants at three of the previous five research settings. These punctuated data-collection periods afforded comparative analyses of students’ computer-mediated test-taking experiences, which were phenomena not documented in the known literature about the initial year of SBAC. As such, the singular research question of this study, i.e., what were high school juniors’ experiences while taking Smarter Balanced Summative Assessments? spurred phenomenological explorations via focus group and individual interviews of a total of 90 participants in-person and via Zoom platform. Subsequently, using MAXQDA Analytics Pro 2024 software, analyses of the three years of data resulted in four critical findings: (1.) Poor incentive structures and unclear reasons why students needed to take SBAC contributed to participants’ lackluster motivation to perform to the best of their abilities on SBAC; (2.) Problematic SBAC content language contributed to students’ frustrations and extraneous cognitive load; (3.) Limited formal computer literacy skills stunted students’ abilities to understand and manipulate SBAC’s logics of semantic and visual discourse designs; and (4.) Time-sensitive affordances of some SBAC tools and design features restricted test-takers from keeping virtual records of their participations within sections and between sections of the same test. These findings signaled five limitations of this study and yielded five recommendations for practice, especially concerning optimal instructional designs tailored for standardized testing preparatory content to be delivered via instructional technology, and the advantages of doing so for student motivation and performance.&lt;/p&gt;","abstract_has_math":false,"creators":["McLean, Cleon M"],"institution":null,"degree_name":"Education, PhD","degree_level":"Restricted to Claremont Colleges Dissertation","degree_discipline":"School of Educational Studies","degree_department":null,"school":null,"contributors":["June Hilton","David Drew"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-01-01T08:00:00Z","date_published":"2024-01-01T08:00:00Z","updated_at":"2026-07-24T01:41:01Z","subjects":["cognitive load theory","extraneous cognitive load","SBAC findings","SBAC recommendations","schema","working memory","Educational Assessment, Evaluation, and Research"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://scholarship.claremont.edu/cgu_etd/792","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["June Hilton","David Drew"]},{"key":"dc:creator","label":"Author","values":["McLean, Cleon M"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-06-01T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["School of Educational Studies"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Restricted to Claremont Colleges Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Education, PhD"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["cognitive load theory","extraneous cognitive load","SBAC findings","SBAC recommendations","schema","working memory","Educational Assessment, Evaluation, and Research"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://scholarship.claremont.edu/cgu_etd/792"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["<p>This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other states, at four different settings in one local unified high school district. The study was then paused for two years to allow for fuller implementation of SBAC. Then, in 2017, the study resumed at the original research settings plus one more with the goal of capturing any significant qualitative data insights into a new group of participants’ SBAC experiences. The study was then paused for a second time to allow for some preliminary data analyses and reflection. Finally, in 2022, the study resumed after adopting and then practicing COVID protocols with a third group of participants at three of the previous five research settings. These punctuated data-collection periods afforded comparative analyses of students’ computer-mediated test-taking experiences, which were phenomena not documented in the known literature about the initial year of SBAC. As such, the singular research question of this study, i.e., what were high school juniors’ experiences while taking Smarter Balanced Summative Assessments? spurred phenomenological explorations via focus group and individual interviews of a total of 90 participants in-person and via Zoom platform. Subsequently, using MAXQDA Analytics Pro 2024 software, analyses of the three years of data resulted in four critical findings: (1.) Poor incentive structures and unclear reasons why students needed to take SBAC contributed to participants’ lackluster motivation to perform to the best of their abilities on SBAC; (2.) Problematic SBAC content language contributed to students’ frustrations and extraneous cognitive load; (3.) Limited formal computer literacy skills stunted students’ abilities to understand and manipulate SBAC’s logics of semantic and visual discourse designs; and (4.) Time-sensitive affordances of some SBAC tools and design features restricted test-takers from keeping virtual records of their participations within sections and between sections of the same test. These findings signaled five limitations of this study and yielded five recommendations for practice, especially concerning optimal instructional designs tailored for standardized testing preparatory content to be delivered via instructional technology, and the advantages of doing so for student motivation and performance.</p>"]},{"key":"dc:title","label":"Title","values":["Exploring Pupil-Perceptions of Computer-Mediated Standardized Assessments"]}]}],"canonical_facts":{"dc:contributor":["June Hilton","David Drew"],"dc:creator":["McLean, Cleon M"],"dc:date.available":["2024-06-01T07:00:00Z"],"dc:description.abstract":["<p>This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other states, at four different settings in one local unified high school district. The study was then paused for two years to allow for fuller implementation of SBAC. Then, in 2017, the study resumed at the original research settings plus one more with the goal of capturing any significant qualitative data insights into a new group of participants’ SBAC experiences. The study was then paused for a second time to allow for some preliminary data analyses and reflection. Finally, in 2022, the study resumed after adopting and then practicing COVID protocols with a third group of participants at three of the previous five research settings. These punctuated data-collection periods afforded comparative analyses of students’ computer-mediated test-taking experiences, which were phenomena not documented in the known literature about the initial year of SBAC. As such, the singular research question of this study, i.e., what were high school juniors’ experiences while taking Smarter Balanced Summative Assessments? spurred phenomenological explorations via focus group and individual interviews of a total of 90 participants in-person and via Zoom platform. Subsequently, using MAXQDA Analytics Pro 2024 software, analyses of the three years of data resulted in four critical findings: (1.) Poor incentive structures and unclear reasons why students needed to take SBAC contributed to participants’ lackluster motivation to perform to the best of their abilities on SBAC; (2.) Problematic SBAC content language contributed to students’ frustrations and extraneous cognitive load; (3.) Limited formal computer literacy skills stunted students’ abilities to understand and manipulate SBAC’s logics of semantic and visual discourse designs; and (4.) Time-sensitive affordances of some SBAC tools and design features restricted test-takers from keeping virtual records of their participations within sections and between sections of the same test. These findings signaled five limitations of this study and yielded five recommendations for practice, especially concerning optimal instructional designs tailored for standardized testing preparatory content to be delivered via instructional technology, and the advantages of doing so for student motivation and performance.</p>"],"dc:identifier":["https://scholarship.claremont.edu/cgu_etd/792"],"dc:subject":["cognitive load theory","extraneous cognitive load","SBAC findings","SBAC recommendations","schema","working memory","Educational Assessment, Evaluation, and Research"],"dc:title":["Exploring Pupil-Perceptions of Computer-Mediated Standardized Assessments"],"thesis:degree_discipline":["School of Educational Studies"],"thesis:degree_level":["Restricted to Claremont Colleges Dissertation"],"thesis:degree_name":["Education, PhD"]},"updated_at":"2026-07-24T01:41:01Z"}