Quantifying the Qualitative: Increasing the Reliability of Subjective Language Assessments

<p>This project explores how to increase the reliability of subjective language assessments. What are the major factors that affect reliability, and what can educators do to maximize it? Research in the field suggests four key factors that have the greatest effect on reliability. The first factor is the procedures used to administer and score the assessment. The more standardized the process is, the higher the reliability will be. The second factor is rater experience, both in the profession and with the assessment in question. Experience is positively correlated with reliability. Novice teachers who get training and feedback in a scoring rubric can become almost as reliable as veteran educators, so training cycles should be a component of any assessment program. The third factor that affects reliability is the type of task the students are asked to do. Tasks that integrate more than one language skill are more reliable than those that use only one skill. The fourth factor is student experience with the testing format. More experience is positively correlated with better achievement, so educators must make sure their students are familiar with the tasks they are asked to do.</p>

Name thesis:degree_name

Master of Arts in Teaching English to Speakers of Other Languages (TESOL)

Level thesis:degree_level

Project/Capstone - Global access

Discipline thesis:degree_discipline

International and Multicultural Education (IME)

Year dc:date.available

2016

Author dc:creator

• Armes, Jeremy W

Contributors dc:contributor

• Dr. Sedique Popal

• Assessment
• Reliability
• Language Testing
• Curriculum and Instruction
• Elementary Education and Teaching
• International and Comparative Education
• Other Teacher Education and Professional Development

Repository record dc:identifier

https://repository.usfca.edu/capstone/338

OAI identifier oai:identifier

oai:repository.usfca.edu:capstone-1355