Controlling item exposure for response time-informed item selection in computerized adaptive testing

Fan et al. (2012) demonstrated that inversely weighting the maximum information criterion (MIC) by the expected response time for each item effectively reduced the average completion time for a test of fixed length while maintaining efficiency of ability estimation. However, this also resulted in an extremely skewed distribution of item exposure rates. To counter this issue, they recommended the use of the a-stratification with b-blocking (ASB) method, which balanced item exposure very well but at the cost of compromising on the average test time reduction and increasing the error of ability estimation. Therefore, the current study investigated several alternative methods for item exposure control when using response time-informed MIC, of which the most promising technique was inversely weighting MIC by the expected response time centered around 1.3. Simulation results showed that this simple modification markedly improved performance over employing ASB when utilizing response time information for item selection in computerized adaptive testing (CAT).

Name thesis:degree_name

M.A.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Psychology

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2014

Author dc:creator

• Choe, Edison

Contributors dc:contributor

• Chang, Hua-Hua

• item exposure
• item selection
• response time
• computerized adaptive testing (CAT)

Statement dc:rights

• Copyright 2014 Edison Choe

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/49591

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/49591