Simulating a virtual drilling task using audio, visual, and mouse movement cues during the COVID-19 pandemic

This work examined whether a real-world drilling task can be successfully simulated using combinations of appropriate audio, visual cues, and basic haptic stimuli obtained with mouse movements instead of a haptic device. Two experiments were conducted where participants were asked to accomplish a virtual drilling task (drilling a block of virtual wood) under different visual, auditory, and “haptic” conditions using some commonly available computer devices such as a mouse, headphones, and monitor. The results of these experiments indicate that audio, visual, and basic haptic cues can be used to simulate a drilling process without a haptic device. Although greater work remains, this work has shown that skills requiring haptic feedback (e.g., drilling) can be simulated without haptic devices. This is particularly important when considering remote learning where trainees may be able to practice various psychomotor-based skills at home with commonly available computer hardware and devices.

Name thesis:degree_name

Master of Science (MSc)

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Ontario Institute of Technology

Year dc:date.issued

2021

Author dc:creator

• Ning, Guoxuan

Advisor dc:contributor.advisor

• Kapralos, Bill

• Audio
• Haptic
• Multimodal interaction
• Human-computer interaction
• Virtual simulation

Language dc:language.iso

en

Handle dc:identifier.uri

https://hdl.handle.net/10155/1353

OAI identifier oai:identifier

oai:ontariotechu.scholaris.ca:10155/1353