{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/86373"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/86373","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"An Empirical Investigation of Several Critical Psychometrical Issues in Neuropsychological Testing of Mild Traumatic Brain Injuries","abstract":"Concussions can cause very serious injuries and with repetitive injuries increase the likelihood of serious consequences. There is an increased awareness of concussions, which has evolved into developing better measurement tools to study the effects including neuropsychological components. Cognitive functions such as, memory, attention, concentration, and reaction time are now commonly assessed for dysfunction in sports related concussions. Although there have been many neuropsychological tests used to identify the effects of concussion, there are several major concerns of the methodological soundness and psychometric quality of commonly used practices. The purpose of this study was to examine the commonly used neuropsychological sports concussion practices used for validity, reliability, and other psychometric characteristics. A windows-based software program was created called Short-term Memory Assessment Recall Tool (SMART) for this study. Item Response Theory (IRT) was employed to address the issues with the common practices, specifically the one-parameter or Rasch model was used. The issues include design, construction, testing paradigm, administration, and scoring or identifying injuries. The results from the IRT calibrations show compliance of the test with the stated test construction and testing paradigm commonly used. There was, however, some administration problems identified relating to the random generated item selection of computerized concussion tests. When the randomness of the items and the difficulty level of the items were controlled for the reliability of SMART was good at R = 0.8. Another finding of the study was using the conditional standard errors from the IRT calibration reduced the range of the 90% confidence interval by over 50%. These issues must be addressed before larger issues of examining whether an individual-centered or criterion-referenced standard should be used. Further investigation into the development and construction of these tests are needed to address the alarming psychometric concerns. It is important for these tests to be constructed and evaluated with sound modern measurement theory. Currently, the commonly used practices are potentially riddled with significant issues and problems.","abstract_html":"Concussions can cause very serious injuries and with repetitive injuries increase the likelihood of serious consequences. There is an increased awareness of concussions, which has evolved into developing better measurement tools to study the effects including neuropsychological components. Cognitive functions such as, memory, attention, concentration, and reaction time are now commonly assessed for dysfunction in sports related concussions. Although there have been many neuropsychological tests used to identify the effects of concussion, there are several major concerns of the methodological soundness and psychometric quality of commonly used practices. The purpose of this study was to examine the commonly used neuropsychological sports concussion practices used for validity, reliability, and other psychometric characteristics. A windows-based software program was created called Short-term Memory Assessment Recall Tool (SMART) for this study. Item Response Theory (IRT) was employed to address the issues with the common practices, specifically the one-parameter or Rasch model was used. The issues include design, construction, testing paradigm, administration, and scoring or identifying injuries. The results from the IRT calibrations show compliance of the test with the stated test construction and testing paradigm commonly used. There was, however, some administration problems identified relating to the random generated item selection of computerized concussion tests. When the randomness of the items and the difficulty level of the items were controlled for the reliability of SMART was good at R = 0.8. Another finding of the study was using the conditional standard errors from the IRT calibration reduced the range of the 90% confidence interval by over 50%. These issues must be addressed before larger issues of examining whether an individual-centered or criterion-referenced standard should be used. Further investigation into the development and construction of these tests are needed to address the alarming psychometric concerns. It is important for these tests to be constructed and evaluated with sound modern measurement theory. Currently, the commonly used practices are potentially riddled with significant issues and problems.","abstract_has_math":false,"creators":["Ragan, Brian George"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Kinesiology and Community Health","degree_department":null,"school":null,"contributors":["Zhu, Weimo"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2015,"date_issued":"2015-09-28T15:04:20Z","date_published":"2015-09-28T15:04:20Z","updated_at":"2026-07-22T22:26:27Z","subjects":["Psychology, Psychometrics"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["(MiAaPQ)AAI3160942"],"render_values":[{"text":"(MiAaPQ)AAI3160942","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/86373","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Zhu, Weimo"]},{"key":"dc:creator","label":"Author","values":["Ragan, Brian George"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2015-09-28T15:04:20Z","10000-01-01","2004"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Kinesiology and Community Health"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Psychology, Psychometrics"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/86373","(MiAaPQ)AAI3160942"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Concussions can cause very serious injuries and with repetitive injuries increase the likelihood of serious consequences. There is an increased awareness of concussions, which has evolved into developing better measurement tools to study the effects including neuropsychological components. Cognitive functions such as, memory, attention, concentration, and reaction time are now commonly assessed for dysfunction in sports related concussions. Although there have been many neuropsychological tests used to identify the effects of concussion, there are several major concerns of the methodological soundness and psychometric quality of commonly used practices. The purpose of this study was to examine the commonly used neuropsychological sports concussion practices used for validity, reliability, and other psychometric characteristics. A windows-based software program was created called Short-term Memory Assessment Recall Tool (SMART) for this study. Item Response Theory (IRT) was employed to address the issues with the common practices, specifically the one-parameter or Rasch model was used. The issues include design, construction, testing paradigm, administration, and scoring or identifying injuries. The results from the IRT calibrations show compliance of the test with the stated test construction and testing paradigm commonly used. There was, however, some administration problems identified relating to the random generated item selection of computerized concussion tests. When the randomness of the items and the difficulty level of the items were controlled for the reliability of SMART was good at R = 0.8. Another finding of the study was using the conditional standard errors from the IRT calibration reduced the range of the 90% confidence interval by over 50%. These issues must be addressed before larger issues of examining whether an individual-centered or criterion-referenced standard should be used. Further investigation into the development and construction of these tests are needed to address the alarming psychometric concerns. It is important for these tests to be constructed and evaluated with sound modern measurement theory. Currently, the commonly used practices are potentially riddled with significant issues and problems.","Made available in DSpace on 2015-09-28T15:04:20Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3160942.pdf: 7366064 bytes, checksum: 0d9b2b69264ea48de333f0b980ebad31 (MD5) Previous issue date: 2004","Embargo set by: Seth Robbins for item 87654 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","197 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2004."]},{"key":"dc:title","label":"Title","values":["An Empirical Investigation of Several Critical Psychometrical Issues in Neuropsychological Testing of Mild Traumatic Brain Injuries"]}]}],"canonical_facts":{"dc:contributor":["Zhu, Weimo"],"dc:creator":["Ragan, Brian George"],"dc:date":["2015-09-28T15:04:20Z","10000-01-01","2004"],"dc:description":["Concussions can cause very serious injuries and with repetitive injuries increase the likelihood of serious consequences. There is an increased awareness of concussions, which has evolved into developing better measurement tools to study the effects including neuropsychological components. Cognitive functions such as, memory, attention, concentration, and reaction time are now commonly assessed for dysfunction in sports related concussions. Although there have been many neuropsychological tests used to identify the effects of concussion, there are several major concerns of the methodological soundness and psychometric quality of commonly used practices. The purpose of this study was to examine the commonly used neuropsychological sports concussion practices used for validity, reliability, and other psychometric characteristics. A windows-based software program was created called Short-term Memory Assessment Recall Tool (SMART) for this study. Item Response Theory (IRT) was employed to address the issues with the common practices, specifically the one-parameter or Rasch model was used. The issues include design, construction, testing paradigm, administration, and scoring or identifying injuries. The results from the IRT calibrations show compliance of the test with the stated test construction and testing paradigm commonly used. There was, however, some administration problems identified relating to the random generated item selection of computerized concussion tests. When the randomness of the items and the difficulty level of the items were controlled for the reliability of SMART was good at R = 0.8. Another finding of the study was using the conditional standard errors from the IRT calibration reduced the range of the 90% confidence interval by over 50%. These issues must be addressed before larger issues of examining whether an individual-centered or criterion-referenced standard should be used. Further investigation into the development and construction of these tests are needed to address the alarming psychometric concerns. It is important for these tests to be constructed and evaluated with sound modern measurement theory. Currently, the commonly used practices are potentially riddled with significant issues and problems.","Made available in DSpace on 2015-09-28T15:04:20Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3160942.pdf: 7366064 bytes, checksum: 0d9b2b69264ea48de333f0b980ebad31 (MD5) Previous issue date: 2004","Embargo set by: Seth Robbins for item 87654 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","197 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2004."],"dc:identifier":["http://hdl.handle.net/2142/86373","(MiAaPQ)AAI3160942"],"dc:language":["eng"],"dc:subject":["Psychology, Psychometrics"],"dc:title":["An Empirical Investigation of Several Critical Psychometrical Issues in Neuropsychological Testing of Mild Traumatic Brain Injuries"],"dc:type":["text"],"thesis:degree_discipline":["Kinesiology and Community Health"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:27Z"}