{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/93064"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/93064","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Examining the fakability of forced-choice individual differences measures","abstract":"Forced-choice (FC) is a popular format for developing noncognitive individual differences measures, where individuals are forced to choose one or multiple statements out of several options. FC measures have been proposed as a valuable approach to reduce score inflation in high-stakes assessments, but their effectiveness has not yet been examined in a meta-analysis. In my dissertation, I conducted two studies to examine the fakability of forced-choice personality and vocational interest measures. In the first study, I conducted a meta-analysis of studies comparing FC personality measures between low-stakes and high-stakes situations. Results suggested that the overall score inflation effect size for FC personality measures is 0.05, which is much lower than the effect size for single-statement measures. The score inflation effect size was also found to vary across FC scale characteristics, study design factors, and personality facets. Specifically, a faking resistant FC scale should be constructed in a multidimensional PICK format, with statements balanced in social desirability and responses scored in a normative approach. Personality facets of high relevance to the target were found to exhibit larger inflation than facets of low relevance to the target job. In the second study, I conducted an induced faking study to examine the fakability of vocational interest measures and whether or not the FC format reduced the faking effect. With a sample of 1,559 respondents, I found that respondents consistently inflated the interest domain that matched the target job, and that the inflation led to a decreased level of criterion-related validity of interest-job fit. Multidimensional FC scales exhibited a smaller inflation effect on non-matched domains, but not on matched domains, than single-statement scales. However, the FC format did not reduce the level of criterion-related validity attenuation found in single-statement measures.","abstract_html":"Forced-choice (FC) is a popular format for developing noncognitive individual differences measures, where individuals are forced to choose one or multiple statements out of several options. FC measures have been proposed as a valuable approach to reduce score inflation in high-stakes assessments, but their effectiveness has not yet been examined in a meta-analysis. In my dissertation, I conducted two studies to examine the fakability of forced-choice personality and vocational interest measures. In the first study, I conducted a meta-analysis of studies comparing FC personality measures between low-stakes and high-stakes situations. Results suggested that the overall score inflation effect size for FC personality measures is 0.05, which is much lower than the effect size for single-statement measures. The score inflation effect size was also found to vary across FC scale characteristics, study design factors, and personality facets. Specifically, a faking resistant FC scale should be constructed in a multidimensional PICK format, with statements balanced in social desirability and responses scored in a normative approach. Personality facets of high relevance to the target were found to exhibit larger inflation than facets of low relevance to the target job. In the second study, I conducted an induced faking study to examine the fakability of vocational interest measures and whether or not the FC format reduced the faking effect. With a sample of 1,559 respondents, I found that respondents consistently inflated the interest domain that matched the target job, and that the inflation led to a decreased level of criterion-related validity of interest-job fit. Multidimensional FC scales exhibited a smaller inflation effect on non-matched domains, but not on matched domains, than single-statement scales. However, the FC format did not reduce the level of criterion-related validity attenuation found in single-statement measures.","abstract_has_math":false,"creators":["Cao, Mengyang"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Drasgow, Fritz","Carpenter, Nichelle C.","Chang, Hua-Hua","Newman, Daniel A.","Rounds, James"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2016,"date_issued":"2016-11-10T18:43:02Z","date_published":"2016-11-10T18:43:02Z","updated_at":"2026-07-22T22:26:35Z","subjects":["forced-choice personality vocational interest faking"],"languages":["en"],"rights":["Copyright 2016 Mengyang Cao"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/93064","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Drasgow, Fritz","Carpenter, Nichelle C.","Chang, Hua-Hua","Newman, Daniel A.","Rounds, James"]},{"key":"dc:creator","label":"Author","values":["Cao, Mengyang"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2016-11-10T18:43:02Z","2018-11-11T10:15:45Z","2016-07-15","2016-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["forced-choice personality vocational interest faking"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2016 Mengyang Cao"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/93064"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Forced-choice (FC) is a popular format for developing noncognitive individual differences measures, where individuals are forced to choose one or multiple statements out of several options. FC measures have been proposed as a valuable approach to reduce score inflation in high-stakes assessments, but their effectiveness has not yet been examined in a meta-analysis. In my dissertation, I conducted two studies to examine the fakability of forced-choice personality and vocational interest measures. In the first study, I conducted a meta-analysis of studies comparing FC personality measures between low-stakes and high-stakes situations. Results suggested that the overall score inflation effect size for FC personality measures is 0.05, which is much lower than the effect size for single-statement measures. The score inflation effect size was also found to vary across FC scale characteristics, study design factors, and personality facets. Specifically, a faking resistant FC scale should be constructed in a multidimensional PICK format, with statements balanced in social desirability and responses scored in a normative approach. Personality facets of high relevance to the target were found to exhibit larger inflation than facets of low relevance to the target job. In the second study, I conducted an induced faking study to examine the fakability of vocational interest measures and whether or not the FC format reduced the faking effect. With a sample of 1,559 respondents, I found that respondents consistently inflated the interest domain that matched the target job, and that the inflation led to a decreased level of criterion-related validity of interest-job fit. Multidimensional FC scales exhibited a smaller inflation effect on non-matched domains, but not on matched domains, than single-statement scales. However, the FC format did not reduce the level of criterion-related validity attenuation found in single-statement measures.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2018-08-01","The student, Mengyang Cao, accepted the attached license on 2016-07-14 at 11:29.","The student, Mengyang Cao, submitted this Dissertation for approval on 2016-07-14 at 11:36.","This Dissertation was approved for publication on 2016-07-15 at 11:00.","DSpace SAF Submission Ingestion Package generated from Vireo submission #9939 on 2016-11-10 at 12:25:26","Made available in DSpace on 2016-11-10T18:43:02Z (GMT). No. of bitstreams: 3 CAO-DISSERTATION-2016.pdf: 1617750 bytes, checksum: 6de8762fc34ccdc4495bb433b9cd82ef (MD5) LICENSE.txt: 4209 bytes, checksum: 3342abaa595e21ea7ae1466f1623b7a4 (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 5feb429d2940d4437dcf8a66b99b055d (MD5) Previous issue date: 2016-07-15","Embargo set by: Seth Robbins for item 95487 Lift date: 2018-11-10T18:43:22Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 95487 on 2018-11-11T10:15:45Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Examining the fakability of forced-choice individual differences measures"]}]}],"canonical_facts":{"dc:contributor":["Drasgow, Fritz","Carpenter, Nichelle C.","Chang, Hua-Hua","Newman, Daniel A.","Rounds, James"],"dc:creator":["Cao, Mengyang"],"dc:date":["2016-11-10T18:43:02Z","2018-11-11T10:15:45Z","2016-07-15","2016-08"],"dc:description":["Forced-choice (FC) is a popular format for developing noncognitive individual differences measures, where individuals are forced to choose one or multiple statements out of several options. FC measures have been proposed as a valuable approach to reduce score inflation in high-stakes assessments, but their effectiveness has not yet been examined in a meta-analysis. In my dissertation, I conducted two studies to examine the fakability of forced-choice personality and vocational interest measures. In the first study, I conducted a meta-analysis of studies comparing FC personality measures between low-stakes and high-stakes situations. Results suggested that the overall score inflation effect size for FC personality measures is 0.05, which is much lower than the effect size for single-statement measures. The score inflation effect size was also found to vary across FC scale characteristics, study design factors, and personality facets. Specifically, a faking resistant FC scale should be constructed in a multidimensional PICK format, with statements balanced in social desirability and responses scored in a normative approach. Personality facets of high relevance to the target were found to exhibit larger inflation than facets of low relevance to the target job. In the second study, I conducted an induced faking study to examine the fakability of vocational interest measures and whether or not the FC format reduced the faking effect. With a sample of 1,559 respondents, I found that respondents consistently inflated the interest domain that matched the target job, and that the inflation led to a decreased level of criterion-related validity of interest-job fit. Multidimensional FC scales exhibited a smaller inflation effect on non-matched domains, but not on matched domains, than single-statement scales. However, the FC format did not reduce the level of criterion-related validity attenuation found in single-statement measures.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2018-08-01","The student, Mengyang Cao, accepted the attached license on 2016-07-14 at 11:29.","The student, Mengyang Cao, submitted this Dissertation for approval on 2016-07-14 at 11:36.","This Dissertation was approved for publication on 2016-07-15 at 11:00.","DSpace SAF Submission Ingestion Package generated from Vireo submission #9939 on 2016-11-10 at 12:25:26","Made available in DSpace on 2016-11-10T18:43:02Z (GMT). No. of bitstreams: 3 CAO-DISSERTATION-2016.pdf: 1617750 bytes, checksum: 6de8762fc34ccdc4495bb433b9cd82ef (MD5) LICENSE.txt: 4209 bytes, checksum: 3342abaa595e21ea7ae1466f1623b7a4 (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 5feb429d2940d4437dcf8a66b99b055d (MD5) Previous issue date: 2016-07-15","Embargo set by: Seth Robbins for item 95487 Lift date: 2018-11-10T18:43:22Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 95487 on 2018-11-11T10:15:45Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/93064"],"dc:language":["en"],"dc:rights":["Copyright 2016 Mengyang Cao"],"dc:subject":["forced-choice personality vocational interest faking"],"dc:title":["Examining the fakability of forced-choice individual differences measures"],"dc:type":["text"],"thesis:degree_discipline":["Psychology"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:35Z"}