{"id":{"repo_id":"ohiolink","oai_identifier":"oai:etd.ohiolink.edu:osu1366204433"},"canonical_url":"https://search.dev.ndltd.org/etd/ohiolink/oai:etd.ohiolink.edu:osu1366204433","repository":{"repo_id":"ohiolink","name":"OhioLINK","base_url":"https://etd.ohiolink.edu/acprod/odb_etd/ws/oai/oai"},"display":{"title":"SCIENTIFIC REASONING:RESEARCH, DEVELOPMENT, AND ASSESSMENT","abstract":"Education in Science, Technology, Engineering, and Math (STEM) is emphasized worldwide. Reports from large-scale international studies such as TIMSS and PISA continually rank U.S. students behind many other nations. As a result, the U.S. has increased its emphasis on the implementation of a more extensive science and mathematics curriculum in K-12 education. In STEM education, widely accepted teaching goals include not only the development of solid content knowledge but also the development of general scientific abilities that will enable students to successfully handle open-ended real-world tasks in future careers. One such ability, scientific reasoning, is closely related to a wide range of general cognitive abilities such as critical thinking and reasoning. Existing research has suggested that scientific reasoning skills can be trained and transferred. Training in scientific reasoning may also have a long-term impact on student academic achievement. In the STEM education community, it has been widely agreed that student development of transferable general abilities is at least as important as certain learned STEM knowledge. Therefore, it is important to investigate how to implement a STEM education program that can help students develop both STEM content knowledge and scientific reasoning.In order to develop such a knowledge base and to assess and evaluate the impact and effectiveness of education methods and resources, we need good assessment tools that can be easily applied in large scale and produce valid results comparable across a wide range of populations. This dissertation project establishes a first step to systematically improve the assessment instrumentation of scientific reasoning. A series of studies have been conducted, which include (1) a detailed validation study of the Lawson’s test, which has identified a number of validity issues including item/choice design issues, item context issues, item structure and wording issues (e.g. two-tier design), the limited scale of measurement range, and the ceiling effect for advanced students, (2) a study to determine the basic measurement features of the Lawson’s test with large scale data, (3) A data-mining study of Lawson’s test data, which helps identify learning progression behaviors of selected scientific reasoning skills. The results also provide evidence for researchers to evaluate and model the scoring methods of two-tiered questions used in the Lawson’s test, and (4) A study with randomized testing to investigate the learning progression of the skill of control of variables (COV), which showed a series of fine grained intermediate levels of COV skills.This project produces rich resources for sustained research and development on scientific reasoning. It establishes a valuable baseline for teachers and researchers to apply the Lawson’s test in research and teaching and a solid foundation for researchers to further develop the next generation assessment instruments on scientific reasoning.","abstract_html":"Education in Science, Technology, Engineering, and Math (STEM) is emphasized worldwide. Reports from large-scale international studies such as TIMSS and PISA continually rank U.S. students behind many other nations. As a result, the U.S. has increased its emphasis on the implementation of a more extensive science and mathematics curriculum in K-12 education. In STEM education, widely accepted teaching goals include not only the development of solid content knowledge but also the development of general scientific abilities that will enable students to successfully handle open-ended real-world tasks in future careers. One such ability, scientific reasoning, is closely related to a wide range of general cognitive abilities such as critical thinking and reasoning. Existing research has suggested that scientific reasoning skills can be trained and transferred. Training in scientific reasoning may also have a long-term impact on student academic achievement. In the STEM education community, it has been widely agreed that student development of transferable general abilities is at least as important as certain learned STEM knowledge. Therefore, it is important to investigate how to implement a STEM education program that can help students develop both STEM content knowledge and scientific reasoning.In order to develop such a knowledge base and to assess and evaluate the impact and effectiveness of education methods and resources, we need good assessment tools that can be easily applied in large scale and produce valid results comparable across a wide range of populations. This dissertation project establishes a first step to systematically improve the assessment instrumentation of scientific reasoning. A series of studies have been conducted, which include (1) a detailed validation study of the Lawson’s test, which has identified a number of validity issues including item/choice design issues, item context issues, item structure and wording issues (e.g. two-tier design), the limited scale of measurement range, and the ceiling effect for advanced students, (2) a study to determine the basic measurement features of the Lawson’s test with large scale data, (3) A data-mining study of Lawson’s test data, which helps identify learning progression behaviors of selected scientific reasoning skills. The results also provide evidence for researchers to evaluate and model the scoring methods of two-tiered questions used in the Lawson’s test, and (4) A study with randomized testing to investigate the learning progression of the skill of control of variables (COV), which showed a series of fine grained intermediate levels of COV skills.This project produces rich resources for sustained research and development on scientific reasoning. It establishes a valuable baseline for teachers and researchers to apply the Lawson’s test in research and teaching and a solid foundation for researchers to further develop the next generation assessment instruments on scientific reasoning.","abstract_has_math":false,"creators":["Han, Jing"],"institution":"The Ohio State University","degree_name":"Doctor of Philosophy","degree_level":"doctoral","degree_discipline":"Physics","degree_department":null,"school":null,"contributors":["Bao, Lei"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-08-08","date_published":"2013-08-08","updated_at":"2026-07-24T03:37:46Z","subjects":["Physics","Education","Educational Evaluation","Scientific reasoning","Reasoning Assessment","Physics Education","Science Method"],"languages":["English"],"rights":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://rave.ohiolink.edu/etdc/view?acc_num=osu1366204433","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Bao, Lei"]},{"key":"dc:creator","label":"Author","values":["Han, Jing"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2013-08-08"]},{"key":"dc:publisher","label":"Institution","values":["The Ohio State University / OhioLINK"]},{"key":"dc:type","label":"Dc Type","values":["Electronic Thesis or Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Physics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["The Ohio State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Physics","Education","Educational Evaluation","Scientific reasoning","Reasoning Assessment","Physics Education","Science Method"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]},{"key":"dc:rights","label":"Dc Rights","values":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://rave.ohiolink.edu/etdc/view?acc_num=osu1366204433"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Education in Science, Technology, Engineering, and Math (STEM) is emphasized worldwide. Reports from large-scale international studies such as TIMSS and PISA continually rank U.S. students behind many other nations. As a result, the U.S. has increased its emphasis on the implementation of a more extensive science and mathematics curriculum in K-12 education. In STEM education, widely accepted teaching goals include not only the development of solid content knowledge but also the development of general scientific abilities that will enable students to successfully handle open-ended real-world tasks in future careers. One such ability, scientific reasoning, is closely related to a wide range of general cognitive abilities such as critical thinking and reasoning. Existing research has suggested that scientific reasoning skills can be trained and transferred. Training in scientific reasoning may also have a long-term impact on student academic achievement. In the STEM education community, it has been widely agreed that student development of transferable general abilities is at least as important as certain learned STEM knowledge. Therefore, it is important to investigate how to implement a STEM education program that can help students develop both STEM content knowledge and scientific reasoning.In order to develop such a knowledge base and to assess and evaluate the impact and effectiveness of education methods and resources, we need good assessment tools that can be easily applied in large scale and produce valid results comparable across a wide range of populations. This dissertation project establishes a first step to systematically improve the assessment instrumentation of scientific reasoning. A series of studies have been conducted, which include (1) a detailed validation study of the Lawson’s test, which has identified a number of validity issues including item/choice design issues, item context issues, item structure and wording issues (e.g. two-tier design), the limited scale of measurement range, and the ceiling effect for advanced students, (2) a study to determine the basic measurement features of the Lawson’s test with large scale data, (3) A data-mining study of Lawson’s test data, which helps identify learning progression behaviors of selected scientific reasoning skills. The results also provide evidence for researchers to evaluate and model the scoring methods of two-tiered questions used in the Lawson’s test, and (4) A study with randomized testing to investigate the learning progression of the skill of control of variables (COV), which showed a series of fine grained intermediate levels of COV skills.This project produces rich resources for sustained research and development on scientific reasoning. It establishes a valuable baseline for teachers and researchers to apply the Lawson’s test in research and teaching and a solid foundation for researchers to further develop the next generation assessment instruments on scientific reasoning."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf","p.243","8.91 MB"]},{"key":"dc:title","label":"Title","values":["SCIENTIFIC REASONING:RESEARCH, DEVELOPMENT, AND ASSESSMENT"]}]}],"canonical_facts":{"dc:contributor":["Bao, Lei"],"dc:creator":["Han, Jing"],"dc:date":["2013-08-08"],"dc:description":["Education in Science, Technology, Engineering, and Math (STEM) is emphasized worldwide. Reports from large-scale international studies such as TIMSS and PISA continually rank U.S. students behind many other nations. As a result, the U.S. has increased its emphasis on the implementation of a more extensive science and mathematics curriculum in K-12 education. In STEM education, widely accepted teaching goals include not only the development of solid content knowledge but also the development of general scientific abilities that will enable students to successfully handle open-ended real-world tasks in future careers. One such ability, scientific reasoning, is closely related to a wide range of general cognitive abilities such as critical thinking and reasoning. Existing research has suggested that scientific reasoning skills can be trained and transferred. Training in scientific reasoning may also have a long-term impact on student academic achievement. In the STEM education community, it has been widely agreed that student development of transferable general abilities is at least as important as certain learned STEM knowledge. Therefore, it is important to investigate how to implement a STEM education program that can help students develop both STEM content knowledge and scientific reasoning.In order to develop such a knowledge base and to assess and evaluate the impact and effectiveness of education methods and resources, we need good assessment tools that can be easily applied in large scale and produce valid results comparable across a wide range of populations. This dissertation project establishes a first step to systematically improve the assessment instrumentation of scientific reasoning. A series of studies have been conducted, which include (1) a detailed validation study of the Lawson’s test, which has identified a number of validity issues including item/choice design issues, item context issues, item structure and wording issues (e.g. two-tier design), the limited scale of measurement range, and the ceiling effect for advanced students, (2) a study to determine the basic measurement features of the Lawson’s test with large scale data, (3) A data-mining study of Lawson’s test data, which helps identify learning progression behaviors of selected scientific reasoning skills. The results also provide evidence for researchers to evaluate and model the scoring methods of two-tiered questions used in the Lawson’s test, and (4) A study with randomized testing to investigate the learning progression of the skill of control of variables (COV), which showed a series of fine grained intermediate levels of COV skills.This project produces rich resources for sustained research and development on scientific reasoning. It establishes a valuable baseline for teachers and researchers to apply the Lawson’s test in research and teaching and a solid foundation for researchers to further develop the next generation assessment instruments on scientific reasoning."],"dc:format":["application/pdf","p.243","8.91 MB"],"dc:identifier":["http://rave.ohiolink.edu/etdc/view?acc_num=osu1366204433"],"dc:language":["English"],"dc:publisher":["The Ohio State University / OhioLINK"],"dc:rights":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."],"dc:subject":["Physics","Education","Educational Evaluation","Scientific reasoning","Reasoning Assessment","Physics Education","Science Method"],"dc:title":["SCIENTIFIC REASONING:RESEARCH, DEVELOPMENT, AND ASSESSMENT"],"dc:type":["Electronic Thesis or Dissertation"],"thesis:degree_discipline":["Physics"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["The Ohio State University"]},"updated_at":"2026-07-24T03:37:46Z"}