{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/79940"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/79940","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"The Effectiveness of Test -Takers' Participation in Development of an Innovative Web -Based Speaking Test for International Teaching Assistants at American Colleges","abstract":"The results of content analysis of the SPEAK showed the mismatch between the purpose and its use in a local context and the findings from the needs analysis were aligned with the team's decisions on test design considerations reflected into the development. The results of the group dynamics and audit trail supported positive contributions of the test-takers to the test development by revealing their roles, interactions, and power relations. The results of the validation studies with the data from test scores and survey and interviews also supported the effectiveness of the test-takers' participation in the test development by indicating their equal contributions to task construction, significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of validating test development process as well as the test product. Through the process, authenticity of topics, content, and other test conditions were achieved in their local academic contexts.","abstract_html":"The results of content analysis of the SPEAK showed the mismatch between the purpose and its use in a local context and the findings from the needs analysis were aligned with the team's decisions on test design considerations reflected into the development. The results of the group dynamics and audit trail supported positive contributions of the test-takers to the test development by revealing their roles, interactions, and power relations. The results of the validation studies with the data from test scores and survey and interviews also supported the effectiveness of the test-takers' participation in the test development by indicating their equal contributions to task construction, significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of validating test development process as well as the test product. Through the process, authenticity of topics, content, and other test conditions were achieved in their local academic contexts.","abstract_has_math":false,"creators":["Kim, Jungtae"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Education","degree_department":null,"school":null,"contributors":["Wardrop, James L."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2015,"date_issued":"2015-09-25T19:54:38Z","date_published":"2015-09-25T19:54:38Z","updated_at":"2026-07-22T22:26:13Z","subjects":["Education, Tests and Measurements"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["(MiAaPQ)AAI3242896"],"render_values":[{"text":"(MiAaPQ)AAI3242896","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/79940","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Wardrop, James L."]},{"key":"dc:creator","label":"Author","values":["Kim, Jungtae"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2015-09-25T19:54:38Z","10000-01-01","2006"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Education"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Education, Tests and Measurements"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/79940","(MiAaPQ)AAI3242896"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The results of content analysis of the SPEAK showed the mismatch between the purpose and its use in a local context and the findings from the needs analysis were aligned with the team's decisions on test design considerations reflected into the development. The results of the group dynamics and audit trail supported positive contributions of the test-takers to the test development by revealing their roles, interactions, and power relations. The results of the validation studies with the data from test scores and survey and interviews also supported the effectiveness of the test-takers' participation in the test development by indicating their equal contributions to task construction, significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of validating test development process as well as the test product. Through the process, authenticity of topics, content, and other test conditions were achieved in their local academic contexts.","Made available in DSpace on 2015-09-25T19:54:38Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3242896.pdf: 6815554 bytes, checksum: 257a9a5e144c228487c4d0e7aaafe2e8 (MD5) Previous issue date: 2006","Embargo set by: Seth Robbins for item 81222 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","333 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2006."]},{"key":"dc:title","label":"Title","values":["The Effectiveness of Test -Takers' Participation in Development of an Innovative Web -Based Speaking Test for International Teaching Assistants at American Colleges"]}]}],"canonical_facts":{"dc:contributor":["Wardrop, James L."],"dc:creator":["Kim, Jungtae"],"dc:date":["2015-09-25T19:54:38Z","10000-01-01","2006"],"dc:description":["The results of content analysis of the SPEAK showed the mismatch between the purpose and its use in a local context and the findings from the needs analysis were aligned with the team's decisions on test design considerations reflected into the development. The results of the group dynamics and audit trail supported positive contributions of the test-takers to the test development by revealing their roles, interactions, and power relations. The results of the validation studies with the data from test scores and survey and interviews also supported the effectiveness of the test-takers' participation in the test development by indicating their equal contributions to task construction, significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of validating test development process as well as the test product. Through the process, authenticity of topics, content, and other test conditions were achieved in their local academic contexts.","Made available in DSpace on 2015-09-25T19:54:38Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3242896.pdf: 6815554 bytes, checksum: 257a9a5e144c228487c4d0e7aaafe2e8 (MD5) Previous issue date: 2006","Embargo set by: Seth Robbins for item 81222 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","333 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2006."],"dc:identifier":["http://hdl.handle.net/2142/79940","(MiAaPQ)AAI3242896"],"dc:language":["eng"],"dc:subject":["Education, Tests and Measurements"],"dc:title":["The Effectiveness of Test -Takers' Participation in Development of an Innovative Web -Based Speaking Test for International Teaching Assistants at American Colleges"],"dc:type":["text"],"thesis:degree_discipline":["Education"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:13Z"}