{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/102513"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/102513","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Though forced, still valid: Psychometric equivalence of forced-choice and single-statement measures","abstract":"Forced choice (FC) measures are gaining popularity as an alternative assessment format to single statement (SS) measures due to their potential in reducing the impact of various response styles and faking. However, a fundamental question remains to be answered: do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? Two studies were designed to answer these questions. Study 1 results showed that FC measures scored by the Multi-unidimensional Pairwise Preference Model (MUPP) and SS measures scored with an ideal point model yielded similar factor structures and almost identical criterion-related validity across 12 criteria. Both formats also had similar pattern of marginal reliabilities and test-retest reliabilities. Study 1 findings were replicated in Study 2. In addition, we found strong evidence for convergent validity between the two formats. Though the FC format was perceived to be more difficult, respondents showed no differential preference and expressed similar level of emotional and cognitive reactions to the two formats.","abstract_html":"Forced choice (FC) measures are gaining popularity as an alternative assessment format to single statement (SS) measures due to their potential in reducing the impact of various response styles and faking. However, a fundamental question remains to be answered: do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? Two studies were designed to answer these questions. Study 1 results showed that FC measures scored by the Multi-unidimensional Pairwise Preference Model (MUPP) and SS measures scored with an ideal point model yielded similar factor structures and almost identical criterion-related validity across 12 criteria. Both formats also had similar pattern of marginal reliabilities and test-retest reliabilities. Study 1 findings were replicated in Study 2. In addition, we found strong evidence for convergent validity between the two formats. Though the FC format was perceived to be more difficult, respondents showed no differential preference and expressed similar level of emotional and cognitive reactions to the two formats.","abstract_has_math":false,"creators":["Zhang, Bo"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Drasgow, Fritz"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-02-06T19:36:43Z","date_published":"2019-02-06T19:36:43Z","updated_at":"2026-07-22T22:24:42Z","subjects":["forced choice, single statement, equivalence, MUPP, ideal point model"],"languages":["en"],"rights":["Copyright 2018 Bo Zhang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/102513","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Drasgow, Fritz"]},{"key":"dc:creator","label":"Author","values":["Zhang, Bo"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2019-02-06T19:36:43Z","2018-12-12","2018-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["forced choice, single statement, equivalence, MUPP, ideal point model"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2018 Bo Zhang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/102513"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Forced choice (FC) measures are gaining popularity as an alternative assessment format to single statement (SS) measures due to their potential in reducing the impact of various response styles and faking. However, a fundamental question remains to be answered: do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? Two studies were designed to answer these questions. Study 1 results showed that FC measures scored by the Multi-unidimensional Pairwise Preference Model (MUPP) and SS measures scored with an ideal point model yielded similar factor structures and almost identical criterion-related validity across 12 criteria. Both formats also had similar pattern of marginal reliabilities and test-retest reliabilities. Study 1 findings were replicated in Study 2. In addition, we found strong evidence for convergent validity between the two formats. Though the FC format was perceived to be more difficult, respondents showed no differential preference and expressed similar level of emotional and cognitive reactions to the two formats.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-02-05 without embargo terms","The student, Bo Zhang, accepted the attached license on 2018-12-11 at 12:39.","The student, Bo Zhang, submitted this Thesis for approval on 2018-12-11 at 16:31.","This Thesis was approved for publication on 2018-12-12 at 09:26.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13288 on 2019-02-05 at 11:16:05","Made available in DSpace on 2019-02-06T19:36:43Z (GMT). No. of bitstreams: 2 ZHANG-THESIS-2018.pdf: 621528 bytes, checksum: f01aa279eb04f260e0a83e51427e0dc5 (MD5) LICENSE.txt: 4205 bytes, checksum: 15a3bb634961c990c6993d65617f2693 (MD5) Previous issue date: 2018-12-12"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Though forced, still valid: Psychometric equivalence of forced-choice and single-statement measures"]}]}],"canonical_facts":{"dc:contributor":["Drasgow, Fritz"],"dc:creator":["Zhang, Bo"],"dc:date":["2019-02-06T19:36:43Z","2018-12-12","2018-12"],"dc:description":["Forced choice (FC) measures are gaining popularity as an alternative assessment format to single statement (SS) measures due to their potential in reducing the impact of various response styles and faking. However, a fundamental question remains to be answered: do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? Two studies were designed to answer these questions. Study 1 results showed that FC measures scored by the Multi-unidimensional Pairwise Preference Model (MUPP) and SS measures scored with an ideal point model yielded similar factor structures and almost identical criterion-related validity across 12 criteria. Both formats also had similar pattern of marginal reliabilities and test-retest reliabilities. Study 1 findings were replicated in Study 2. In addition, we found strong evidence for convergent validity between the two formats. Though the FC format was perceived to be more difficult, respondents showed no differential preference and expressed similar level of emotional and cognitive reactions to the two formats.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-02-05 without embargo terms","The student, Bo Zhang, accepted the attached license on 2018-12-11 at 12:39.","The student, Bo Zhang, submitted this Thesis for approval on 2018-12-11 at 16:31.","This Thesis was approved for publication on 2018-12-12 at 09:26.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13288 on 2019-02-05 at 11:16:05","Made available in DSpace on 2019-02-06T19:36:43Z (GMT). No. of bitstreams: 2 ZHANG-THESIS-2018.pdf: 621528 bytes, checksum: f01aa279eb04f260e0a83e51427e0dc5 (MD5) LICENSE.txt: 4205 bytes, checksum: 15a3bb634961c990c6993d65617f2693 (MD5) Previous issue date: 2018-12-12"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/102513"],"dc:language":["en"],"dc:rights":["Copyright 2018 Bo Zhang"],"dc:subject":["forced choice, single statement, equivalence, MUPP, ideal point model"],"dc:title":["Though forced, still valid: Psychometric equivalence of forced-choice and single-statement measures"],"dc:type":["text"],"thesis:degree_discipline":["Psychology"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:42Z"}