A matter of context: Contextualization enhances the criterion-related validity of forced-choice measurement

Previous studies showed that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures using an experimental design and cross-validates results through two forced-choice personality measures. We also report the effect of contextualization on discriminant validity. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity, followed by statement contextualization only and then instruction contextualization only. The original scales with no contextualization showed the lowest levels of criterion-related validity. As for discriminant validity, contextualization increased intercorrelations. These patterns were well replicated across the two forced-choice scales.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Psychology

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2023

Author dc:creator

• Li, Lingyue

Contributors dc:contributor

• Drasgow, Fritz

• Forced-choice
• Personality
• Contextualization
• Validity
• Measurement

Statement dc:rights

• Copyright 2023 Lingyue Li

Language dc:language

en, eng

Handle dc:identifier

https://hdl.handle.net/2142/120478

OAI record oai:identifier

https://www.ideals.illinois.edu/oai-pmh?verb=GetRecord&metadataPrefix=etdms&identifier=oai%3Awww.ideals.illinois.edu%3A2142%2F120478