{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/34534"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/34534","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Item selection methods in multidimensional computerized adaptive testing adopting polytomously-scored items under multidimensional generalized partial credit model","abstract":"Four item selection methods are compared and investigated under three test formats in the context of Multidimensional Computerized Adaptive Testing (MCAT) delivering polytomous items partially or completely in tests. Item selection methods examined include Fisher information based D-optimality (D-optimality), Kullback-Leibler information index (KI), mutual information (MI), and continuous entropy method (CEM). The three test formats considered are the POLYTYPE format that contains polytomous items with three response categories, the DPMIX format that delivers dichotomous items at the beginning and polytomous items at the final stage, and the PDMIX format that has the reverse order as DPMIX. In general, D-optimality shows the best estimation accuracy and conditional estimation accuracy. D-optimality, MI, and CEM are similar in terms of ability estimation accuracy and tendency in selecting items when the item bank size is large. For both dichotomous and polytomous items, KI is mostly outperformed by the other three methods in terms of ability estimation precision.When sub-thetas in both dimensions are equal,however,KI shows the best performance for polytomous items. In this study, which item type, dichotomous or polytomous, being administered first does not affect the estimation accuracy. However, if the test length is much longer or shorter than the test length of the current study, it is possible that the estimation accuracy could be affected by the order of delivering different item types. Both DPMIX and PDMIX formats yield similar conditional estimation accuracy pattern and precision. In addition, the item bank size does affect the estimation precision. These conclusions, however, might not be applied to MCAT testing with different test designs or item pool structures. More studies are needed in MCAT combining with polytomous items to further facilitate the development and improvement of the next-generation assessments such as formative assessment or testing for diagnosis.","abstract_html":"Four item selection methods are compared and investigated under three test formats in the context of Multidimensional Computerized Adaptive Testing (MCAT) delivering polytomous items partially or completely in tests. Item selection methods examined include Fisher information based D-optimality (D-optimality), Kullback-Leibler information index (KI), mutual information (MI), and continuous entropy method (CEM). The three test formats considered are the POLYTYPE format that contains polytomous items with three response categories, the DPMIX format that delivers dichotomous items at the beginning and polytomous items at the final stage, and the PDMIX format that has the reverse order as DPMIX. In general, D-optimality shows the best estimation accuracy and conditional estimation accuracy. D-optimality, MI, and CEM are similar in terms of ability estimation accuracy and tendency in selecting items when the item bank size is large. For both dichotomous and polytomous items, KI is mostly outperformed by the other three methods in terms of ability estimation precision.When sub-thetas in both dimensions are equal,however,KI shows the best performance for polytomous items. In this study, which item type, dichotomous or polytomous, being administered first does not affect the estimation accuracy. However, if the test length is much longer or shorter than the test length of the current study, it is possible that the estimation accuracy could be affected by the order of delivering different item types. Both DPMIX and PDMIX formats yield similar conditional estimation accuracy pattern and precision. In addition, the item bank size does affect the estimation precision. These conclusions, however, might not be applied to MCAT testing with different test designs or item pool structures. More studies are needed in MCAT combining with polytomous items to further facilitate the development and improvement of the next-generation assessments such as formative assessment or testing for diagnosis.","abstract_has_math":false,"creators":["Lin, Haiyan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Educational Psychology","degree_department":null,"school":null,"contributors":["Chang, Hua-Hua","Ryan, Katherine E.","Anderson, Carolyn J.","Douglas, Jeffrey A."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2012,"date_issued":"2012-09-18T21:24:31Z","date_published":"2012-09-18T21:24:31Z","updated_at":"2026-07-22T22:25:31Z","subjects":["Multidimensional Computerized Adaptive Testing","Item Selection Methods","Multidimensional Item Response Theory","Multidimensional Generalized Partial Credit Model"],"languages":["en"],"rights":["Copyright 2012 Haiyan Lin"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/34534","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Chang, Hua-Hua","Ryan, Katherine E.","Anderson, Carolyn J.","Douglas, Jeffrey A."]},{"key":"dc:creator","label":"Author","values":["Lin, Haiyan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2012-09-18T21:24:31Z","2014-09-18T10:00:56Z","2012-08"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Educational Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Multidimensional Computerized Adaptive Testing","Item Selection Methods","Multidimensional Item Response Theory","Multidimensional Generalized Partial Credit Model"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2012 Haiyan Lin"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/34534"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Four item selection methods are compared and investigated under three test formats in the context of Multidimensional Computerized Adaptive Testing (MCAT) delivering polytomous items partially or completely in tests. Item selection methods examined include Fisher information based D-optimality (D-optimality), Kullback-Leibler information index (KI), mutual information (MI), and continuous entropy method (CEM). The three test formats considered are the POLYTYPE format that contains polytomous items with three response categories, the DPMIX format that delivers dichotomous items at the beginning and polytomous items at the final stage, and the PDMIX format that has the reverse order as DPMIX. In general, D-optimality shows the best estimation accuracy and conditional estimation accuracy. D-optimality, MI, and CEM are similar in terms of ability estimation accuracy and tendency in selecting items when the item bank size is large. For both dichotomous and polytomous items, KI is mostly outperformed by the other three methods in terms of ability estimation precision.When sub-thetas in both dimensions are equal,however,KI shows the best performance for polytomous items. In this study, which item type, dichotomous or polytomous, being administered first does not affect the estimation accuracy. However, if the test length is much longer or shorter than the test length of the current study, it is possible that the estimation accuracy could be affected by the order of delivering different item types. Both DPMIX and PDMIX formats yield similar conditional estimation accuracy pattern and precision. In addition, the item bank size does affect the estimation precision. These conclusions, however, might not be applied to MCAT testing with different test designs or item pool structures. More studies are needed in MCAT combining with polytomous items to further facilitate the development and improvement of the next-generation assessments such as formative assessment or testing for diagnosis.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-10T21:54:25Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 5 LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5) LIN_HAIYAN.pdf: 1212545 bytes, checksum: 2f7ca88efa4b85b9ac2ceadd411af675 (MD5) LIN_HAIYAN.pdf: 1212661 bytes, checksum: 530aafbe7b8936c3693cebc6a5720671 (MD5) LIN_HAIYAN.doc: 3859456 bytes, checksum: f4dd666d1dd9f559e66cbbe6b6909c10 (MD5) LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5)","Made available in DSpace on 2012-09-18T21:24:31Z (GMT). No. of bitstreams: 3 LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5) LIN_HAIYAN.doc: 3859456 bytes, checksum: f4dd666d1dd9f559e66cbbe6b6909c10 (MD5) license.txt: 4057 bytes, checksum: 3244810c501445a7f1cbb363fb30286a (MD5)","Restriction data tranferred 2014-07-01T11:35:44-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:22Z Item is restricted until 2014-09-18T21:27:16Z","Limited Restriction Lifted for Item 34808 on 2014-09-18T10:00:56Z."]},{"key":"dc:title","label":"Title","values":["Item selection methods in multidimensional computerized adaptive testing adopting polytomously-scored items under multidimensional generalized partial credit model"]}]}],"canonical_facts":{"dc:contributor":["Chang, Hua-Hua","Ryan, Katherine E.","Anderson, Carolyn J.","Douglas, Jeffrey A."],"dc:creator":["Lin, Haiyan"],"dc:date":["2012-09-18T21:24:31Z","2014-09-18T10:00:56Z","2012-08"],"dc:description":["Four item selection methods are compared and investigated under three test formats in the context of Multidimensional Computerized Adaptive Testing (MCAT) delivering polytomous items partially or completely in tests. Item selection methods examined include Fisher information based D-optimality (D-optimality), Kullback-Leibler information index (KI), mutual information (MI), and continuous entropy method (CEM). The three test formats considered are the POLYTYPE format that contains polytomous items with three response categories, the DPMIX format that delivers dichotomous items at the beginning and polytomous items at the final stage, and the PDMIX format that has the reverse order as DPMIX. In general, D-optimality shows the best estimation accuracy and conditional estimation accuracy. D-optimality, MI, and CEM are similar in terms of ability estimation accuracy and tendency in selecting items when the item bank size is large. For both dichotomous and polytomous items, KI is mostly outperformed by the other three methods in terms of ability estimation precision.When sub-thetas in both dimensions are equal,however,KI shows the best performance for polytomous items. In this study, which item type, dichotomous or polytomous, being administered first does not affect the estimation accuracy. However, if the test length is much longer or shorter than the test length of the current study, it is possible that the estimation accuracy could be affected by the order of delivering different item types. Both DPMIX and PDMIX formats yield similar conditional estimation accuracy pattern and precision. In addition, the item bank size does affect the estimation precision. These conclusions, however, might not be applied to MCAT testing with different test designs or item pool structures. More studies are needed in MCAT combining with polytomous items to further facilitate the development and improvement of the next-generation assessments such as formative assessment or testing for diagnosis.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-10T21:54:25Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 5 LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5) LIN_HAIYAN.pdf: 1212545 bytes, checksum: 2f7ca88efa4b85b9ac2ceadd411af675 (MD5) LIN_HAIYAN.pdf: 1212661 bytes, checksum: 530aafbe7b8936c3693cebc6a5720671 (MD5) LIN_HAIYAN.doc: 3859456 bytes, checksum: f4dd666d1dd9f559e66cbbe6b6909c10 (MD5) LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5)","Made available in DSpace on 2012-09-18T21:24:31Z (GMT). No. of bitstreams: 3 LIN_HAIYAN.pdf: 1212663 bytes, checksum: d854318a78af24d39f2f953828862736 (MD5) LIN_HAIYAN.doc: 3859456 bytes, checksum: f4dd666d1dd9f559e66cbbe6b6909c10 (MD5) license.txt: 4057 bytes, checksum: 3244810c501445a7f1cbb363fb30286a (MD5)","Restriction data tranferred 2014-07-01T11:35:44-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:22Z Item is restricted until 2014-09-18T21:27:16Z","Limited Restriction Lifted for Item 34808 on 2014-09-18T10:00:56Z."],"dc:identifier":["http://hdl.handle.net/2142/34534"],"dc:language":["en"],"dc:rights":["Copyright 2012 Haiyan Lin"],"dc:subject":["Multidimensional Computerized Adaptive Testing","Item Selection Methods","Multidimensional Item Response Theory","Multidimensional Generalized Partial Credit Model"],"dc:title":["Item selection methods in multidimensional computerized adaptive testing adopting polytomously-scored items under multidimensional generalized partial credit model"],"thesis:degree_discipline":["Educational Psychology"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:31Z"}