Guidelines for the interpretation of NCDIF as an effect size measure

Several statistics have been proposed to detect Differential Item Functioning (DIF) and quantify its magnitude. However, not all DIF statistics quantify the same population parameters and, therefore, cannot be interpreted interchangeably. We focus on deriving principled guidelines for the interpretation of the non-compensatory differential item functioning (NCDIF) parameter as a DIF effect size measure. This parameter quantifies the expected (average) effect of the possible differences between item parameters on the (squared differences of the) item score for the focal population of examinees. We first investigate in which situations the Delta Mantel-Haenszel (ΔMH) is comparable to NCDIF, so that the ETS cutoff points can serve meaningfully as a benchmark. Then, we examine the parameter’s behavior under various conditions of uniform and non-uniform DIF, as well as the effect that the distribution of the focal group exerts on its magnitude. Lastly, using one of the estimators of the NCDIF parameter, we evaluate the accuracy of the derived classification rules for NCDIF and identify an approximate bias correction for this estimator. Overall, these results provide useful guidelines for interpreting the magnitude of NCDIF that are consistent with its specific nature and improve the alignment of DIF classifications with the magnitude of the NCDIF parameter.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Psychology

Grantor

University of Illinois Urbana-Champaign

Year dc:date

2025

Author dc:creator

• Le, Trung Tran Quoc

Contributors dc:contributor

• Cervantes, Víctor H
• Zhang, Susu

• differential item functioning
• DIF
• NCDIF
• effect size

Statement dc:rights

• Copyright 2025 Trung Le

Language dc:language

en

Handle dc:identifier

https://hdl.handle.net/2142/132579

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/132579