In search of folk fairness in language testing

Fairness is generally defined as a social value that applies in understanding, interpreting social actions, and making decisions over human performance. In the field of testing, the concept of fairness is commonly defined as social justice or equity which is associated with equal opportunity and equitable treatment. The purpose of the present study is to seek to understand the process through which examinees construct and interpret the concept of fairness in the standardized language testing such as the Test of English as a Foreign Language (TOEFL). To investigate three main research questions proposed in this study, I utilized a mixed methods research design comprising both quantitative and qualitative approaches. Reliabilities and exploratory factor analyses were performed to examine the factor structure of the concept of test fairness using large-scale quantitative data. Several Analysis of Variance tests were performed to examine group characteristics effects on conceptions of test fairness. Focus group and individual interviews were conducted to understand test takers' making sense of their test taking experience in relation to test fairness. Results from analyses of the data from both quantitative and qualitative research methods support the conclusion that the concept of test fairness is multi-faceted, dynamic and both culturally and contextually situated. The author argues that fairness is not derived from a test itself, but it is constructed interpreted and practiced in different ways by various stakeholders. Therefore, the goal of test fairness studies should not be only to seek for a decisive criterion by which a test is judged as either 'fair' or 'unfair,' but also to represent diverse voices of co-participants in testing practice. The study concludes that social inquiry about test fairness would be enhanced through collaborative dialogic engagement with all testing practice participants.

Name thesis:degree_name

M.A.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Teaching English as a Second Language

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2002

Author dc:creator

• Jang, Eunice Eunhee

Contributors dc:contributor

• Davidson, Fred

• Teaching English as Second Language

Statement dc:rights

• Copyright by Eunice Eunhee Jang, 2002

Language dc:language

eng

Handle dc:identifier

https://hdl.handle.net/2142/125893

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/125893