A Study of the Robustness of the Three-Parameter Item Response Model
type: CreativeWork
description: Simulation techniques were employed to investigate the use of the three-parameter item response model on psychological test data which violated the model's assumptions of large sample sizes, long tests and test unidimensionality. The accuracy of the person ability and item characteristic curve parameter estimates derived by the three-parameter item response model was evaluated. Data sets and distributions of person ability and item characteristic curve parameters were generated using a computer-based algorithm, AVRAM (Ree, 1980), which employs the three-parameter logistic probability equation described by Birnbaum (1968). A computer software package, LOGIST5 (Wingersky, Burton & Lord, 1982), which utilizes the three-parameter logistic probability equation, was used to derive the parameter estimates for the person response and the item characteristic curves. The present study based its analyses on the unedited person-item data matrix. As such, the findings are somewhat inconsistent with those reported by studies employing an edited data matrix (e.g., Ree, 1979). However, these findings are much more consistent with the types of test situations likely to occur in industrial-organizational research, where the focus of research will be the evaluation of differences in individual and group test scores as opposed to the design and construction of tests. The results showed that the item discrimination, ai, and lower asymptote, ci, parameters of the item characteristic curve were both accurately recovered when small sample sizes and short tests were used, and conditions of item bias existed. The person ability parameter, Bv was also accurately recovered. The recovery of bi, the item difficulty parameter, was most affected. The average absolute differences and root-mean-square errors obtained on bi were extremely large relative to those obtained on ai and ci, as well as, those reported for bi elsewhere in the literature (Ree, 1979). Not only were the individual parameter est…
abstract: Simulation techniques were employed to investigate the use of the three-parameter item response model on psychological test data which violated the model's assumptions of large sample sizes, long tests and test unidimensionality. The accuracy of the person ability and item characteristic curve parameter estimates derived by the three-parameter item response model was evaluated. Data sets and distributions of person ability and item characteristic curve parameters were generated using a computer-based algorithm, AVRAM (Ree, 1980), which employs the three-parameter logistic probability equation described by Birnbaum (1968). A computer software package, LOGIST5 (Wingersky, Burton & Lord, 1982), which utilizes the three-parameter logistic probability equation, was used to derive the parameter estimates for the person response and the item characteristic curves. The present study based its analyses on the unedited person-item data matrix. As such, the findings are somewhat inconsistent with those reported by studies employing an edited data matrix (e.g., Ree, 1979). However, these findings are much more consistent with the types of test situations likely to occur in industrial-organizational research, where the focus of research will be the evaluation of differences in individual and group test scores as opposed to the design and construction of tests. The results showed that the item discrimination, ai, and lower asymptote, ci, parameters of the item characteristic curve were both accurately recovered when small sample sizes and short tests were used, and conditions of item bias existed. The person ability parameter, Bv was also accurately recovered. The recovery of bi, the item difficulty parameter, was most affected. The average absolute differences and root-mean-square errors obtained on bi were extremely large relative to those obtained on ai and ci, as well as, those reported for bi elsewhere in the literature (Ree, 1979). Not only were the individual parameter est…
author: Flynn, James B.
keywords: Educational tests, Item response theory, Simulation, Educational Psychology
date published: 1984-01-01T08:00:00Z
date modified: 2026-07-24T03:35:15Z
provider: Old Dominion University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Old Dominion University