{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/102913"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/102913","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Effects of respondent training on self-report personality assessment: an item response theory approach","abstract":"Within the item response theory (IRT) framework and inspired by the rater training literature, this study explored the effects of short online respondent training on personality item interpretation and responding and the number of response categories (i.e. polytomous vs. dichotomous) on item performance, model-data fit, and criterion-related validity. Participants recruited from MTurk (n = 1977) were randomly assigned to 1 of the 4 groups differing in training (i.e. training vs. no training) and response scale (i.e. 4-point Likert scale vs. dichotomous), and their responses to dominance and ideal-point personality measures were analyzed with GGUM, SGR, and 2PL. Results indicated that training was associated with more well-performing and more discriminating and informative intermediate items on the ideal-point scales when a dichotomous response scale was used. The dichotomous scale in general was related to better fit, while criterion-related validity stayed unaffected by both training and the response scale. Participants reported that they had been confused about personality items before, and were positive about the online training, which was consistent with the finding that trained participants on average spent 32 seconds less finishing the ideal-point surveys. Implications for future research and practice are discussed.","abstract_html":"Within the item response theory (IRT) framework and inspired by the rater training literature, this study explored the effects of short online respondent training on personality item interpretation and responding and the number of response categories (i.e. polytomous vs. dichotomous) on item performance, model-data fit, and criterion-related validity. Participants recruited from MTurk (n = 1977) were randomly assigned to 1 of the 4 groups differing in training (i.e. training vs. no training) and response scale (i.e. 4-point Likert scale vs. dichotomous), and their responses to dominance and ideal-point personality measures were analyzed with GGUM, SGR, and 2PL. Results indicated that training was associated with more well-performing and more discriminating and informative intermediate items on the ideal-point scales when a dichotomous response scale was used. The dichotomous scale in general was related to better fit, while criterion-related validity stayed unaffected by both training and the response scale. Participants reported that they had been confused about personality items before, and were positive about the online training, which was consistent with the finding that trained participants on average spent 32 seconds less finishing the ideal-point surveys. Implications for future research and practice are discussed.","abstract_has_math":false,"creators":["Zhang, Luyao"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Drasgow, Fritz","Chang, Hua-Hua","Fraley, R. Chris","Newman, Daniel","Roberts, Brent","Rounds, James"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-02-08T18:39:46Z","date_published":"2019-02-08T18:39:46Z","updated_at":"2026-07-22T22:24:42Z","subjects":["Rater training","item response theory (IRT)","self-report personality assessment","the ideal-point model","intermediate items"],"languages":["en"],"rights":["Copyright 2018 Luyao Zhang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/102913","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Drasgow, Fritz","Chang, Hua-Hua","Fraley, R. Chris","Newman, Daniel","Roberts, Brent","Rounds, James"]},{"key":"dc:creator","label":"Author","values":["Zhang, Luyao"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2019-02-08T18:39:46Z","2021-02-09T10:15:38Z","2018-11-26","2018-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Rater training","item response theory (IRT)","self-report personality assessment","the ideal-point model","intermediate items"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2018 Luyao Zhang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/102913"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Within the item response theory (IRT) framework and inspired by the rater training literature, this study explored the effects of short online respondent training on personality item interpretation and responding and the number of response categories (i.e. polytomous vs. dichotomous) on item performance, model-data fit, and criterion-related validity. Participants recruited from MTurk (n = 1977) were randomly assigned to 1 of the 4 groups differing in training (i.e. training vs. no training) and response scale (i.e. 4-point Likert scale vs. dichotomous), and their responses to dominance and ideal-point personality measures were analyzed with GGUM, SGR, and 2PL. Results indicated that training was associated with more well-performing and more discriminating and informative intermediate items on the ideal-point scales when a dichotomous response scale was used. The dichotomous scale in general was related to better fit, while criterion-related validity stayed unaffected by both training and the response scale. Participants reported that they had been confused about personality items before, and were positive about the online training, which was consistent with the finding that trained participants on average spent 32 seconds less finishing the ideal-point surveys. Implications for future research and practice are discussed.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2020-12-01","The student, Luyao Zhang, accepted the attached license on 2018-11-16 at 19:22.","The student, Luyao Zhang, submitted this Dissertation for approval on 2018-11-16 at 19:33.","This Dissertation was approved for publication on 2018-11-26 at 09:23.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13094 on 2019-02-08 at 11:39:03","Made available in DSpace on 2019-02-08T18:39:46Z (GMT). No. of bitstreams: 3 ZHANG-DISSERTATION-2018.pdf: 5934638 bytes, checksum: 6855bd5dcb2f1e1648f0a22e31e9e6be (MD5) LICENSE.txt: 4208 bytes, checksum: bbd15085950545e3e9b0fe36a5b7137e (MD5) PROQUEST_LICENSE.txt: 4554 bytes, checksum: 090a72e16b196a88f4c2b8750a30c8f7 (MD5) Previous issue date: 2018-11-26","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:40:00Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:42:23Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:43:54Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:44:50Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 109939 on 2021-02-09T10:15:38Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Effects of respondent training on self-report personality assessment: an item response theory approach"]}]}],"canonical_facts":{"dc:contributor":["Drasgow, Fritz","Chang, Hua-Hua","Fraley, R. Chris","Newman, Daniel","Roberts, Brent","Rounds, James"],"dc:creator":["Zhang, Luyao"],"dc:date":["2019-02-08T18:39:46Z","2021-02-09T10:15:38Z","2018-11-26","2018-12"],"dc:description":["Within the item response theory (IRT) framework and inspired by the rater training literature, this study explored the effects of short online respondent training on personality item interpretation and responding and the number of response categories (i.e. polytomous vs. dichotomous) on item performance, model-data fit, and criterion-related validity. Participants recruited from MTurk (n = 1977) were randomly assigned to 1 of the 4 groups differing in training (i.e. training vs. no training) and response scale (i.e. 4-point Likert scale vs. dichotomous), and their responses to dominance and ideal-point personality measures were analyzed with GGUM, SGR, and 2PL. Results indicated that training was associated with more well-performing and more discriminating and informative intermediate items on the ideal-point scales when a dichotomous response scale was used. The dichotomous scale in general was related to better fit, while criterion-related validity stayed unaffected by both training and the response scale. Participants reported that they had been confused about personality items before, and were positive about the online training, which was consistent with the finding that trained participants on average spent 32 seconds less finishing the ideal-point surveys. Implications for future research and practice are discussed.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2020-12-01","The student, Luyao Zhang, accepted the attached license on 2018-11-16 at 19:22.","The student, Luyao Zhang, submitted this Dissertation for approval on 2018-11-16 at 19:33.","This Dissertation was approved for publication on 2018-11-26 at 09:23.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13094 on 2019-02-08 at 11:39:03","Made available in DSpace on 2019-02-08T18:39:46Z (GMT). No. of bitstreams: 3 ZHANG-DISSERTATION-2018.pdf: 5934638 bytes, checksum: 6855bd5dcb2f1e1648f0a22e31e9e6be (MD5) LICENSE.txt: 4208 bytes, checksum: bbd15085950545e3e9b0fe36a5b7137e (MD5) PROQUEST_LICENSE.txt: 4554 bytes, checksum: 090a72e16b196a88f4c2b8750a30c8f7 (MD5) Previous issue date: 2018-11-26","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:40:00Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:42:23Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:43:54Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 109939 Lift date: 2021-02-08T18:44:50Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 109939 on 2021-02-09T10:15:38Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/102913"],"dc:language":["en"],"dc:rights":["Copyright 2018 Luyao Zhang"],"dc:subject":["Rater training","item response theory (IRT)","self-report personality assessment","the ideal-point model","intermediate items"],"dc:title":["Effects of respondent training on self-report personality assessment: an item response theory approach"],"dc:type":["text"],"thesis:degree_discipline":["Psychology"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:42Z"}