{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/44681"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/44681","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"Computer-assisted item and test pre-analysis: a new direction in qualitative methods","abstract":"To date, the major emphasis in test and item evaluation has been directed toward statistical post-measures which rely heavily on data gathered from the administration of the instrument. These primarily summative techniques are limited, however, in that they are incapable of providing information about and item/test before it has been sent for field trials. This research presents a new direction in test and item analysis which, using test/item writing heuristics, provides a previously unavailable technology for instrument pre-analysis. The new field of \"qualitative item and test pre-analysis\" is proposed and described. The implications to the field are discussed in addition to specific suggestions for the use of this new technology. The design and creation of a base-case item and test pre-analysis expert system (ITAX) is also detailed, including the heuristics incorporated, implementation methodologies and limitations. The heuristics incorporated into the system include the detection of: two varieties of grammatical cues, negation/multiple negation, repetition of phrases within an options list, presence of too few options, inconsistent length of distractors, use of all- and none-of-the-above, repetition of significant words from the stem to the options, randomness of multiple choice answer placement, balance of true/false items and length of true/false items. A comprehensive reference to the system is also provided.","abstract_html":"To date, the major emphasis in test and item evaluation has been directed toward statistical post-measures which rely heavily on data gathered from the administration of the instrument. These primarily summative techniques are limited, however, in that they are incapable of providing information about and item/test before it has been sent for field trials. This research presents a new direction in test and item analysis which, using test/item writing heuristics, provides a previously unavailable technology for instrument pre-analysis. The new field of "qualitative item and test pre-analysis" is proposed and described. The implications to the field are discussed in addition to specific suggestions for the use of this new technology. The design and creation of a base-case item and test pre-analysis expert system (ITAX) is also detailed, including the heuristics incorporated, implementation methodologies and limitations. The heuristics incorporated into the system include the detection of: two varieties of grammatical cues, negation/multiple negation, repetition of phrases within an options list, presence of too few options, inconsistent length of distractors, use of all- and none-of-the-above, repetition of significant words from the stem to the options, randomness of multiple choice answer placement, balance of true/false items and length of true/false items. A comprehensive reference to the system is also provided.","abstract_has_math":false,"creators":["Sales, Clay Alan"],"institution":"Virginia Tech","degree_name":"Master of Arts","degree_level":"masters","degree_discipline":"Curriculum and Instruction","degree_department":"Curriculum and Instruction","school":null,"contributors":[],"advisors":[],"committee_chairs":["Burton, John K."],"committee_members":["Weber, Larry J.","Foutz, Patricia Bartos"],"year":1987,"date_issued":"1987-08-05","date_published":"1987-08-05","updated_at":"2026-07-22T22:18:49Z","subjects":[],"languages":[],"rights":["In Copyright"],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-09082012-040509"],"render_values":[{"text":"etd-09082012-040509","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/10919/44681","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Burton, John K."]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Weber, Larry J.","Foutz, Patricia Bartos"]},{"key":"dc:contributor.department","label":"Department","values":["Curriculum and Instruction"]},{"key":"dc:creator","label":"Author","values":["Sales, Clay Alan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2014-03-14T21:45:14Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2014-03-14T21:45:14Z","2012-09-08"]},{"key":"dc:date.issued","label":"Date","values":["1987-08-05"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.dcmitype","label":"Dc Type Dcmitype","values":["Text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Curriculum and Instruction"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Arts"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-09082012-040509"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10919/44681"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["To date, the major emphasis in test and item evaluation has been directed toward statistical post-measures which rely heavily on data gathered from the administration of the instrument. These primarily summative techniques are limited, however, in that they are incapable of providing information about and item/test before it has been sent for field trials. This research presents a new direction in test and item analysis which, using test/item writing heuristics, provides a previously unavailable technology for instrument pre-analysis. The new field of \"qualitative item and test pre-analysis\" is proposed and described. The implications to the field are discussed in addition to specific suggestions for the use of this new technology. The design and creation of a base-case item and test pre-analysis expert system (ITAX) is also detailed, including the heuristics incorporated, implementation methodologies and limitations. The heuristics incorporated into the system include the detection of: two varieties of grammatical cues, negation/multiple negation, repetition of phrases within an options list, presence of too few options, inconsistent length of distractors, use of all- and none-of-the-above, repetition of significant words from the stem to the options, randomness of multiple choice answer placement, balance of true/false items and length of true/false items. A comprehensive reference to the system is also provided."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Master of Arts"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["BTD"]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Computer-assisted item and test pre-analysis: a new direction in qualitative methods"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Burton, John K."],"dc:contributor.committeemember":["Weber, Larry J.","Foutz, Patricia Bartos"],"dc:contributor.department":["Curriculum and Instruction"],"dc:creator":["Sales, Clay Alan"],"dc:date.accessioned":["2014-03-14T21:45:14Z"],"dc:date.available":["2014-03-14T21:45:14Z","2012-09-08"],"dc:date.issued":["1987-08-05"],"dc:description.abstract":["To date, the major emphasis in test and item evaluation has been directed toward statistical post-measures which rely heavily on data gathered from the administration of the instrument. These primarily summative techniques are limited, however, in that they are incapable of providing information about and item/test before it has been sent for field trials. This research presents a new direction in test and item analysis which, using test/item writing heuristics, provides a previously unavailable technology for instrument pre-analysis. The new field of \"qualitative item and test pre-analysis\" is proposed and described. The implications to the field are discussed in addition to specific suggestions for the use of this new technology. The design and creation of a base-case item and test pre-analysis expert system (ITAX) is also detailed, including the heuristics incorporated, implementation methodologies and limitations. The heuristics incorporated into the system include the detection of: two varieties of grammatical cues, negation/multiple negation, repetition of phrases within an options list, presence of too few options, inconsistent length of distractors, use of all- and none-of-the-above, repetition of significant words from the stem to the options, randomness of multiple choice answer placement, balance of true/false items and length of true/false items. A comprehensive reference to the system is also provided."],"dc:description.degree":["Master of Arts"],"dc:format.medium":["BTD"],"dc:format.mimetype":["application/pdf"],"dc:identifier.other":["etd-09082012-040509"],"dc:identifier.uri":["http://hdl.handle.net/10919/44681"],"dc:publisher":["Virginia Tech"],"dc:rights":["In Copyright"],"dc:rights.uri":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:title":["Computer-assisted item and test pre-analysis: a new direction in qualitative methods"],"dc:type":["Thesis"],"dc:type.dcmitype":["Text"],"thesis:degree_discipline":["Curriculum and Instruction"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Arts"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:18:49Z"}