Exploring Instructors' Classroom Test Beliefs and Behaviors in Fundamental Engineering Courses: A Qualitative Multi-Case Study

Classroom tests are a common and default form of assessments in concept-heavy, fundamental engineering courses. Tests have benefits to learning, such as the testing effect that helps with the retrieval of knowledge, but there are also disadvantages, like discouraging deep learning approaches and decreasing motivation to learn, that warrant examining and questioning why tests are common, which engineering education literature lacks. Furthermore, the advancement of assessment research has led to alternative assessments that can diversify types of assessments and promote intentionality in test usage in these courses, supporting the need for scholarship on understanding test usage. My research began to address this by studying fundamental engineering course instructors' test beliefs and behaviors because engineering instructors have shown to have autonomy in making course decisions and barriers to adopting scholarship-based assessment practices among these engineering instructors persist. This dissertation study, grounded in the Situated Expectancy Value Theory (SEVT), explored, uncovered, and articulated seven fundamental engineering course instructors' test beliefs and behaviors from mechanical engineering and engineering science departments in a public, land-grant, Research 1 institution. Leveraging the case study research methodology from a pragmatic perspective, my multi-case study, with each participant being defined as a case, answered an overarching research question and five sub-research questions that yielded findings on five test aspects: test usage, design, administration, cheating, and fairness. Eight collected data sources in the form of qualitative interviews, course, department, and institution documents became the database to answer the questions. Analyses of these data involved coding and content analysis, and subsequent thematic analysis. The outcome of these analyses shaped the individual case profiles for cross-case analysis to understand belief and behavior patterns at a higher level. My research has found three groups of test usage beliefs. These are enthusiastic test users, default test users, and skeptical test users. All participants featured tests heavily in their courses and justified with learning outcomes and some non-course-content factors like large class sizes for grading conveniences. However, those in default and skeptical test user groups also acknowledged some non-course-content factors, like inertia and peer pressure, that influenced their test usage beliefs and behaviors. All participants acknowledged some disadvantages with tests, but those who are skeptical with test usage presented stronger beliefs about test disadvantages, arguing for the need to move away from tests when necessary. Some participants also presented conflicting beliefs and behaviors regarding their test usage. My study has also found all participants using problem-solving questions, emphasizing the need to curb cheating especially during the Covid-19 pandemic, preferring in-person test administration, and defining test fairness with reasonable completion time and adequate content coverage. These findings contribute to addressing identified research gaps in the literature and have implications for future research on tests with assessment philosophies, classroom practices on diversifying assessments and intentional test usage, and future research on possible assessment roles in addressing systemic inequity in engineering.

Name thesis:degree_name

Doctor of Philosophy

Level thesis:degree_level

doctoral

Discipline thesis:degree_discipline

Engineering Education

Department dc:contributor.department

Engineering Education

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2022

Author dc:creator

• Chew, Kai Jun

Chair dc:contributor.committeechair

• Matusovich, Holly M.

Committee members dc:contributor.committeemember

• Sheppard, Sheri D.
• Lee, Walter C.
• Pitterson, Nicole
• Katz, Andrew Scott

• Test
• exams
• engineering
• instructors
• beliefs
• behaviors

Statement dc:rights

• In Copyright

Licence dc:rights.uri

• http://rightsstatements.org/vocab/InC/1.0/

Language dc:language.iso

en

Dc Identifier Other

vt_gsexam:35372

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/111611