Measurement equivalence of the Comprehensive Personality Scales across cultures: an item response theory approach
type: CreativeWork
description: Within the item response theory (IRT) framework, this study compared cross-culturally different approaches to the assessment of differential item functioning (DIF) in two personality tests of the Comprehensive Personality Scale (Wang, 2013). A dominance IRT model (SGRM) and an ideal point model (the GGUM) were applied within the NHST paradigm, due to the debate over which is the more appropriate model for personality research. Nye’s (2011) DIF effect size measure was also used in the current study to overcome the oversensitivity of NHST to large sample size. Participants from the U.S. (n = 861) and China (n = 1023) responded to two personality scales from the CPS: the Well-being scale, and the Curiosity scale. Results indicated that SGR was applicable for DIF assessment, but the NHST paradigm was so sensitive to large samples that even trivial DIF could be significant. GGUM failed to work in the DIF analyses due to ill-conditioned matrices. The DIF effect size measure compensated for the NHST method by providing the magnitude of DIF. Implications for future research and practice are discussed.
abstract: Within the item response theory (IRT) framework, this study compared cross-culturally different approaches to the assessment of differential item functioning (DIF) in two personality tests of the Comprehensive Personality Scale (Wang, 2013). A dominance IRT model (SGRM) and an ideal point model (the GGUM) were applied within the NHST paradigm, due to the debate over which is the more appropriate model for personality research. Nye’s (2011) DIF effect size measure was also used in the current study to overcome the oversensitivity of NHST to large sample size. Participants from the U.S. (n = 861) and China (n = 1023) responded to two personality scales from the CPS: the Well-being scale, and the Curiosity scale. Results indicated that SGR was applicable for DIF assessment, but the NHST paradigm was so sensitive to large samples that even trivial DIF could be significant. GGUM failed to work in the DIF analyses due to ill-conditioned matrices. The DIF effect size measure compensated for the NHST method by providing the magnitude of DIF. Implications for future research and practice are discussed.
author: Zhang, Luyao
language: en
keywords: Item response theory, Differential item functioning (DIF), Dominance model, Samejima's graded response (SGR) model, Ideal point model, The generalized graded unfolding model (GGUM)
date published: 2017-08-10T19:51:37Z
date modified: 2026-07-22T22:24:34Z
provider: University of Illinois - Urbana-Champaign
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Illinois at Urbana-Champaign

PropertyValue
property ID: Handle
value: http://hdl.handle.net/2142/97538