The Effectiveness of Test -Takers' Participation in Development of an Innovative Web -Based Speaking Test for International Teaching Assistants at American Colleges

The results of content analysis of the SPEAK showed the mismatch between the purpose and its use in a local context and the findings from the needs analysis were aligned with the team's decisions on test design considerations reflected into the development. The results of the group dynamics and audit trail supported positive contributions of the test-takers to the test development by revealing their roles, interactions, and power relations. The results of the validation studies with the data from test scores and survey and interviews also supported the effectiveness of the test-takers' participation in the test development by indicating their equal contributions to task construction, significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of validating test development process as well as the test product. Through the process, authenticity of topics, content, and other test conditions were achieved in their local academic contexts.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Education

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2015

Author dc:creator

• Kim, Jungtae

Contributors dc:contributor

• Wardrop, James L.

• Education, Tests and Measurements

Language dc:language

eng

Identifier

(MiAaPQ)AAI3242896

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/79940