{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/104986"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/104986","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Systematic replications and statistical reproducibility of educational research","abstract":"Science is at a critical juncture: the findings of many studies are unable to be replicated and reproduced, while scientific output is growing exponentially and becoming easily accessible. The inability of findings to replicate has been particularly prominent in the field of psychology, where it has been estimated that less than half of findings are able to be replicated. A similar conclusion has been drawn about educational research. At the same time, thousands of papers are published making it increasingly difficult for researchers to know whether or not findings have replicated. This thesis addresses the replicability and reproducibility of educational research and proposes tools that could help researchers sift through large amounts of scholarly output. The first paper of this thesis differentiates between the ideas of replicability and reproducibility, and describes how educational researchers can design systematic replications and report the details needed to reproduce statistical analyses. The second paper examines the use of different text classifiers to extract details about the findings and contextual factors of published articles, where this information can be used by researchers to determine whether two papers are systematic replications of one another. The third paper develops text classifiers to identify the details needed to reproduce the statistical analyses in published papers. These three papers demonstrate there are many components needed to replicate and reproduce educational studies, and these details are sometimes easily identified by text classifiers.","abstract_html":"Science is at a critical juncture: the findings of many studies are unable to be replicated and reproduced, while scientific output is growing exponentially and becoming easily accessible. The inability of findings to replicate has been particularly prominent in the field of psychology, where it has been estimated that less than half of findings are able to be replicated. A similar conclusion has been drawn about educational research. At the same time, thousands of papers are published making it increasingly difficult for researchers to know whether or not findings have replicated. This thesis addresses the replicability and reproducibility of educational research and proposes tools that could help researchers sift through large amounts of scholarly output. The first paper of this thesis differentiates between the ideas of replicability and reproducibility, and describes how educational researchers can design systematic replications and report the details needed to reproduce statistical analyses. The second paper examines the use of different text classifiers to extract details about the findings and contextual factors of published articles, where this information can be used by researchers to determine whether two papers are systematic replications of one another. The third paper develops text classifiers to identify the details needed to reproduce the statistical analyses in published papers. These three papers demonstrate there are many components needed to replicate and reproduce educational studies, and these details are sometimes easily identified by text classifiers.","abstract_has_math":false,"creators":["Crues, Robert Wesley"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Educational Psychology","degree_department":null,"school":null,"contributors":["Anderson, Carolyn J.","Perry, Michelle","Paquette, Luc","Zhai, ChengXiang"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-08-23T20:35:44Z","date_published":"2019-08-23T20:35:44Z","updated_at":"2026-07-22T22:24:44Z","subjects":["systematic replication, statistical reproducibility, text mining"],"languages":["en"],"rights":["Copyright 2019 Robert Crues"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/104986","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Anderson, Carolyn J.","Perry, Michelle","Paquette, Luc","Zhai, ChengXiang"]},{"key":"dc:creator","label":"Author","values":["Crues, Robert Wesley"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2019-08-23T20:35:44Z","2021-08-24T09:15:24Z","2019-04-01","2019-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Educational Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["systematic replication, statistical reproducibility, text mining"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2019 Robert Crues"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/104986"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Science is at a critical juncture: the findings of many studies are unable to be replicated and reproduced, while scientific output is growing exponentially and becoming easily accessible. The inability of findings to replicate has been particularly prominent in the field of psychology, where it has been estimated that less than half of findings are able to be replicated. A similar conclusion has been drawn about educational research. At the same time, thousands of papers are published making it increasingly difficult for researchers to know whether or not findings have replicated. This thesis addresses the replicability and reproducibility of educational research and proposes tools that could help researchers sift through large amounts of scholarly output. The first paper of this thesis differentiates between the ideas of replicability and reproducibility, and describes how educational researchers can design systematic replications and report the details needed to reproduce statistical analyses. The second paper examines the use of different text classifiers to extract details about the findings and contextual factors of published articles, where this information can be used by researchers to determine whether two papers are systematic replications of one another. The third paper develops text classifiers to identify the details needed to reproduce the statistical analyses in published papers. These three papers demonstrate there are many components needed to replicate and reproduce educational studies, and these details are sometimes easily identified by text classifiers.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2021-05-01","The student, Robert Crues, accepted the attached license on 2019-04-01 at 09:10.","The student, Robert Crues, submitted this Dissertation for approval on 2019-04-01 at 09:15.","This Dissertation was approved for publication on 2019-04-01 at 10:20.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13475 on 2019-08-22 at 15:05:17","Made available in DSpace on 2019-08-23T20:35:44Z (GMT). No. of bitstreams: 3 CRUES-DISSERTATION-2019.pdf: 523205 bytes, checksum: daeeab75c9e6f9cf19d573e6b2c8aaa7 (MD5) LICENSE.txt: 4209 bytes, checksum: dbc087c6ae116a59ff344181cf693e6d (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 6c903fa415d4f92d0fb35337c63c3435 (MD5) Previous issue date: 2019-04-01","Embargo set by: Seth Robbins for item 112105 Lift date: 2021-08-23T20:36:18Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 112105 on 2021-08-24T09:15:24Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Systematic replications and statistical reproducibility of educational research"]}]}],"canonical_facts":{"dc:contributor":["Anderson, Carolyn J.","Perry, Michelle","Paquette, Luc","Zhai, ChengXiang"],"dc:creator":["Crues, Robert Wesley"],"dc:date":["2019-08-23T20:35:44Z","2021-08-24T09:15:24Z","2019-04-01","2019-05"],"dc:description":["Science is at a critical juncture: the findings of many studies are unable to be replicated and reproduced, while scientific output is growing exponentially and becoming easily accessible. The inability of findings to replicate has been particularly prominent in the field of psychology, where it has been estimated that less than half of findings are able to be replicated. A similar conclusion has been drawn about educational research. At the same time, thousands of papers are published making it increasingly difficult for researchers to know whether or not findings have replicated. This thesis addresses the replicability and reproducibility of educational research and proposes tools that could help researchers sift through large amounts of scholarly output. The first paper of this thesis differentiates between the ideas of replicability and reproducibility, and describes how educational researchers can design systematic replications and report the details needed to reproduce statistical analyses. The second paper examines the use of different text classifiers to extract details about the findings and contextual factors of published articles, where this information can be used by researchers to determine whether two papers are systematic replications of one another. The third paper develops text classifiers to identify the details needed to reproduce the statistical analyses in published papers. These three papers demonstrate there are many components needed to replicate and reproduce educational studies, and these details are sometimes easily identified by text classifiers.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2021-05-01","The student, Robert Crues, accepted the attached license on 2019-04-01 at 09:10.","The student, Robert Crues, submitted this Dissertation for approval on 2019-04-01 at 09:15.","This Dissertation was approved for publication on 2019-04-01 at 10:20.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13475 on 2019-08-22 at 15:05:17","Made available in DSpace on 2019-08-23T20:35:44Z (GMT). No. of bitstreams: 3 CRUES-DISSERTATION-2019.pdf: 523205 bytes, checksum: daeeab75c9e6f9cf19d573e6b2c8aaa7 (MD5) LICENSE.txt: 4209 bytes, checksum: dbc087c6ae116a59ff344181cf693e6d (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 6c903fa415d4f92d0fb35337c63c3435 (MD5) Previous issue date: 2019-04-01","Embargo set by: Seth Robbins for item 112105 Lift date: 2021-08-23T20:36:18Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 112105 on 2021-08-24T09:15:24Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/104986"],"dc:language":["en"],"dc:rights":["Copyright 2019 Robert Crues"],"dc:subject":["systematic replication, statistical reproducibility, text mining"],"dc:title":["Systematic replications and statistical reproducibility of educational research"],"dc:type":["text"],"thesis:degree_discipline":["Educational Psychology"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:44Z"}