{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/21983"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/21983","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"The effect of specificity of language test specifications on item construction","abstract":"In criterion-referenced testing, test specifications presenting the explicit guidelines for the construction of test items have been regarded as a significant tool for securing content validity of the test. It is because the requirements or conditions for the development of test items stated in test specifications are believed to help construct the homogenous items originally intended, delimiting the scope of test items. The dilemma of this item construction method lies in the high degree of explicitness: The item writer is likely to ignore the detailed description of test specifications due to practical reasons such as lack of time and/or expense. Keeping these concerns in mind, this research aims to investigate the effect of the explicitness of language test specifications on item construction.","abstract_html":"In criterion-referenced testing, test specifications presenting the explicit guidelines for the construction of test items have been regarded as a significant tool for securing content validity of the test. It is because the requirements or conditions for the development of test items stated in test specifications are believed to help construct the homogenous items originally intended, delimiting the scope of test items. The dilemma of this item construction method lies in the high degree of explicitness: The item writer is likely to ignore the detailed description of test specifications due to practical reasons such as lack of time and/or expense. Keeping these concerns in mind, this research aims to investigate the effect of the explicitness of language test specifications on item construction.","abstract_has_math":false,"creators":["Cho, Dongwan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Education","degree_department":null,"school":null,"contributors":["McClure, Erica F."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2011,"date_issued":"2011-05-07T13:25:13Z","date_published":"2011-05-07T13:25:13Z","updated_at":"2026-07-22T22:25:19Z","subjects":["Education, Language and Literature","Education, Tests and Measurements"],"languages":["eng"],"rights":["Copyright 1995 Cho, Dongwan"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9522093","(UMI)AAI9522093"],"render_values":[{"text":"AAI9522093","href":null,"code":true},{"text":"(UMI)AAI9522093","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/21983","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["McClure, Erica F."]},{"key":"dc:creator","label":"Author","values":["Cho, Dongwan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2011-05-07T13:25:13Z","10000-01-01","1995"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Education"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Education, Language and Literature","Education, Tests and Measurements"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 1995 Cho, Dongwan"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9522093","(UMI)AAI9522093","http://hdl.handle.net/2142/21983"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In criterion-referenced testing, test specifications presenting the explicit guidelines for the construction of test items have been regarded as a significant tool for securing content validity of the test. It is because the requirements or conditions for the development of test items stated in test specifications are believed to help construct the homogenous items originally intended, delimiting the scope of test items. The dilemma of this item construction method lies in the high degree of explicitness: The item writer is likely to ignore the detailed description of test specifications due to practical reasons such as lack of time and/or expense. Keeping these concerns in mind, this research aims to investigate the effect of the explicitness of language test specifications on item construction.","For the purposes of this study, three test specifications for an ESL reading comprehension test differing in their degree of explicitness were developed. On the basis of these three test specifications, nine item writers developed 54 items. A test consisting of 15 items chosen out of the 54 was administered to 527 ESL students.","The 54 items developed were examined by three judges with respect to the quality of items. The assessment of the judges showed that the items developed on the basis of less explicit test specifications were better than those using more explicit test specifications. The statistical analysis of the test using classical test theory, item response theory, and distracter analysis, however, showed somewhat different results in that the more explicit test specifications were better than the less explicit ones in the construction of correct response and distracters.","The results of this study led us to make the following suggestions: (a) test specifications do not have to be as explicit as they could be, (b) the construction of test specifications should reflect the item writer's opinions and difficulties, and (c) test development should be an ongoing process. In order to implement the aforementioned suggestions, more research oriented towards qualitative and longitudinal paradigms, which is expected to reveal test development processes, should be conducted in the language testing field.","Made available in DSpace on 2011-05-07T13:25:13Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9522093.pdf: 11041070 bytes, checksum: c55cf84f04364cd520699478328b21b1 (MD5) Previous issue date: 1995","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:54:32Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:25:21-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"]},{"key":"dc:title","label":"Title","values":["The effect of specificity of language test specifications on item construction"]}]}],"canonical_facts":{"dc:contributor":["McClure, Erica F."],"dc:creator":["Cho, Dongwan"],"dc:date":["2011-05-07T13:25:13Z","10000-01-01","1995"],"dc:description":["In criterion-referenced testing, test specifications presenting the explicit guidelines for the construction of test items have been regarded as a significant tool for securing content validity of the test. It is because the requirements or conditions for the development of test items stated in test specifications are believed to help construct the homogenous items originally intended, delimiting the scope of test items. The dilemma of this item construction method lies in the high degree of explicitness: The item writer is likely to ignore the detailed description of test specifications due to practical reasons such as lack of time and/or expense. Keeping these concerns in mind, this research aims to investigate the effect of the explicitness of language test specifications on item construction.","For the purposes of this study, three test specifications for an ESL reading comprehension test differing in their degree of explicitness were developed. On the basis of these three test specifications, nine item writers developed 54 items. A test consisting of 15 items chosen out of the 54 was administered to 527 ESL students.","The 54 items developed were examined by three judges with respect to the quality of items. The assessment of the judges showed that the items developed on the basis of less explicit test specifications were better than those using more explicit test specifications. The statistical analysis of the test using classical test theory, item response theory, and distracter analysis, however, showed somewhat different results in that the more explicit test specifications were better than the less explicit ones in the construction of correct response and distracters.","The results of this study led us to make the following suggestions: (a) test specifications do not have to be as explicit as they could be, (b) the construction of test specifications should reflect the item writer's opinions and difficulties, and (c) test development should be an ongoing process. In order to implement the aforementioned suggestions, more research oriented towards qualitative and longitudinal paradigms, which is expected to reveal test development processes, should be conducted in the language testing field.","Made available in DSpace on 2011-05-07T13:25:13Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9522093.pdf: 11041070 bytes, checksum: c55cf84f04364cd520699478328b21b1 (MD5) Previous issue date: 1995","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:54:32Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:25:21-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"],"dc:identifier":["AAI9522093","(UMI)AAI9522093","http://hdl.handle.net/2142/21983"],"dc:language":["eng"],"dc:rights":["Copyright 1995 Cho, Dongwan"],"dc:subject":["Education, Language and Literature","Education, Tests and Measurements"],"dc:title":["The effect of specificity of language test specifications on item construction"],"dc:type":["text"],"thesis:degree_discipline":["Education"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:19Z"}