{"id":{"repo_id":"buffalo","oai_identifier":"oai:ubir.buffalo.edu:10477/78052"},"canonical_url":"https://search.dev.ndltd.org/etd/buffalo/oai:ubir.buffalo.edu:10477/78052","repository":{"repo_id":"buffalo","name":"Buffalo","base_url":"https://ubir.buffalo.edu/oai/request"},"display":{"title":"The Effect of Test Administration Modes in the Assessment of the Next Generation Science Standards","abstract":"Ph.D.","abstract_html":"Ph.D.","abstract_has_math":false,"creators":["Chi, Shaohui; 0000-0002-1261-7951"],"institution":"State University of New York at Buffalo","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":["Liu, Xiufeng","Learning and Instruction"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018-06-28T20:33:13Z","date_published":"2018-06-28T20:33:13Z","updated_at":"2026-07-27T19:05:07Z","subjects":["science education"],"languages":["eng"],"rights":["Users of works found in University at Buffalo Institutional Repository (UBIR) are responsible for identifying and contacting the copyright owner for permission to reuse. University at Buffalo Libraries do not manage rights for copyright-protected works and cannot assist with permissions.","Copyright retained by author."],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/10477/78052","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Liu, Xiufeng","Learning and Instruction"]},{"key":"dc:creator","label":"Author","values":["Chi, Shaohui; 0000-0002-1261-7951"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2018-06-28T20:33:13Z","2018","2018-05-16 17:32:06"]},{"key":"dc:publisher","label":"Institution","values":["State University of New York at Buffalo"]},{"key":"dc:type","label":"Dc Type","values":["Text","Dissertation"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["science education"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Users of works found in University at Buffalo Institutional Repository (UBIR) are responsible for identifying and contacting the copyright owner for permission to reuse. University at Buffalo Libraries do not manage rights for copyright-protected works and cannot assist with permissions.","Copyright retained by author."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/10477/78052"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Ph.D.","The Performance Expectations described in the Next Generation Science Standards (NGSS) pose significant challenges for assessment design. Multiple models of assessments, including paper-and-pencil and hands-on based performance assessments, can be utilized to assess student competency while applying scientific and engineering practices, in the context of disciplinary core ideas and crosscutting concepts. However, the unique features of different assessments may lead to test mode effects. Accordingly, there is an urgent need for empirical studies on the comparability and score equivalency of these different test modes. This study aims to develop a measurement instrument involving two test administration modes (i.e., a paper-and-pencil test and a hands-on based test), for measuring students' proficiencies in science, as expected in the NGSS (Achieve, 2013). Additionally, this study aims to validate the instrument measures, and to investigate the test administration mode effects, as well as interaction effects between trait and mode, gender and trait/mode . The instrument was developed through pilot-testing, followed by field-testing. The field testing took place in Jiangsu, China, and involved 2604 ninth graders from four Jiangsu-area junior high schools. Each participant completed both the paper-based test and the hands-on based test. The Many-Facet partial credit Rasch model was applied to the field test data, in order to establish evidence of the validity and reliability of the instrument measures, and to investigate the test administration mode effects and interaction effects. The results indicated that measures from this instrument are reasonably valid and reliable, and thus are appropriate for assessing students' competencies in science, reflecting the integration of the three dimensions envisioned by the National Research Council Framework and the NGSS. The findings also indicated that there are significant test administration mode effects and interaction effects between mode and trait, gender and mode/trait. Students' preference for a certain test mode, and their prior experience in taking hands-on based tests, can also significantly impact their hands-on based test performance.","**To request an accessible version of the file(s) associated with this item, contact library@buffalo.edu. Please include the item's persistent URL [http://hdl.handle.net/. . .] in your request.**"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["The Effect of Test Administration Modes in the Assessment of the Next Generation Science Standards"]}]}],"canonical_facts":{"dc:contributor":["Liu, Xiufeng","Learning and Instruction"],"dc:creator":["Chi, Shaohui; 0000-0002-1261-7951"],"dc:date":["2018-06-28T20:33:13Z","2018","2018-05-16 17:32:06"],"dc:description":["Ph.D.","The Performance Expectations described in the Next Generation Science Standards (NGSS) pose significant challenges for assessment design. Multiple models of assessments, including paper-and-pencil and hands-on based performance assessments, can be utilized to assess student competency while applying scientific and engineering practices, in the context of disciplinary core ideas and crosscutting concepts. However, the unique features of different assessments may lead to test mode effects. Accordingly, there is an urgent need for empirical studies on the comparability and score equivalency of these different test modes. This study aims to develop a measurement instrument involving two test administration modes (i.e., a paper-and-pencil test and a hands-on based test), for measuring students' proficiencies in science, as expected in the NGSS (Achieve, 2013). Additionally, this study aims to validate the instrument measures, and to investigate the test administration mode effects, as well as interaction effects between trait and mode, gender and trait/mode . The instrument was developed through pilot-testing, followed by field-testing. The field testing took place in Jiangsu, China, and involved 2604 ninth graders from four Jiangsu-area junior high schools. Each participant completed both the paper-based test and the hands-on based test. The Many-Facet partial credit Rasch model was applied to the field test data, in order to establish evidence of the validity and reliability of the instrument measures, and to investigate the test administration mode effects and interaction effects. The results indicated that measures from this instrument are reasonably valid and reliable, and thus are appropriate for assessing students' competencies in science, reflecting the integration of the three dimensions envisioned by the National Research Council Framework and the NGSS. The findings also indicated that there are significant test administration mode effects and interaction effects between mode and trait, gender and mode/trait. Students' preference for a certain test mode, and their prior experience in taking hands-on based tests, can also significantly impact their hands-on based test performance.","**To request an accessible version of the file(s) associated with this item, contact library@buffalo.edu. Please include the item's persistent URL [http://hdl.handle.net/. . .] in your request.**"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/10477/78052"],"dc:language":["eng"],"dc:publisher":["State University of New York at Buffalo"],"dc:rights":["Users of works found in University at Buffalo Institutional Repository (UBIR) are responsible for identifying and contacting the copyright owner for permission to reuse. University at Buffalo Libraries do not manage rights for copyright-protected works and cannot assist with permissions.","Copyright retained by author."],"dc:subject":["science education"],"dc:title":["The Effect of Test Administration Modes in the Assessment of the Next Generation Science Standards"],"dc:type":["Text","Dissertation"]},"updated_at":"2026-07-27T19:05:07Z"}