{"id":{"repo_id":"colo-mines","oai_identifier":"oai:repository.mines.edu:11124/174146"},"canonical_url":"https://search.dev.ndltd.org/etd/colo-mines/oai:repository.mines.edu:11124/174146","repository":{"repo_id":"colo-mines","name":"Colorado School of Mines","base_url":"https://repository.mines.edu/server/oai/request"},"display":{"title":"Exploring mixed reality robot communication under different types of mental workload","abstract":"Research has shown that the use of physical deictic gestures such as pointing and presenting by robots enables more effective and natural human-robot interaction. However, not all robots come equipped with gestural capabilities. Recent advances in augmented reality (AR) and mixed reality (MR) provide powerful new forms of deictic gestures in human-robot communication. My thesis focuses on allocentric mixed reality gestures, in which target referents are picked out in fields of view of human teammates using AR visualizations such as circles and arrows, especially when these gestures are paired with verbal referring expressions and deployed under various types of mental workload of human teammates. We also present a software architecture that enables mixed reality gestural capabilities, and present the results of a human subject experiment that measures user objective performance and their subjective responses. These results demonstrate the trade-offs between different types of mixed reality robotic communication under different levels of user workload. The findings of this study suggest that although humans may not notice differences, the manner of load a user is under and the type of communication style used by a robot they interact with do in fact interact to determine their task time. The data collected from my experiment is a first step towards answering this overarching question: How can a robot select the most effective communication modality given information regarding its human teammate's level and type of mental workload?","abstract_html":"Research has shown that the use of physical deictic gestures such as pointing and presenting by robots enables more effective and natural human-robot interaction. However, not all robots come equipped with gestural capabilities. Recent advances in augmented reality (AR) and mixed reality (MR) provide powerful new forms of deictic gestures in human-robot communication. My thesis focuses on allocentric mixed reality gestures, in which target referents are picked out in fields of view of human teammates using AR visualizations such as circles and arrows, especially when these gestures are paired with verbal referring expressions and deployed under various types of mental workload of human teammates. We also present a software architecture that enables mixed reality gestural capabilities, and present the results of a human subject experiment that measures user objective performance and their subjective responses. These results demonstrate the trade-offs between different types of mixed reality robotic communication under different levels of user workload. The findings of this study suggest that although humans may not notice differences, the manner of load a user is under and the type of communication style used by a robot they interact with do in fact interact to determine their task time. The data collected from my experiment is a first step towards answering this overarching question: How can a robot select the most effective communication modality given information regarding its human teammate's level and type of mental workload?","abstract_has_math":false,"creators":["Tran, Nhan"],"institution":"Colorado School of Mines. Arthur Lakes Library","degree_name":"Master of Science (M.S.)","degree_level":"Masters","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":[],"advisors":["Williams, Thomas"],"committee_chairs":[],"committee_members":["Camp, Tracy","Hirshfield, Leanne"],"year":2020,"date_issued":"2020","date_published":"2020","updated_at":"2026-07-24T01:42:11Z","subjects":["augmented reality","human-robot interaction","AR/VR","mixed reality","human-computer interaction"],"languages":["eng","English"],"rights":["Copyright of the original work is retained by the author."],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["T 8955"],"render_values":[{"text":"T 8955","href":null,"code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/11124/174146","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Williams, Thomas"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Camp, Tracy","Hirshfield, Leanne"]},{"key":"dc:creator","label":"Author","values":["Tran, Nhan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2020-06-07T10:14:45Z","2022-02-03T13:19:51Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2020-06-07T10:14:45Z","2022-02-03T13:19:51Z"]},{"key":"dc:date.issued","label":"Date","values":["2020"]},{"key":"dc:publisher","label":"Institution","values":["Colorado School of Mines. Arthur Lakes Library"]},{"key":"dc:type","label":"Dc Type","values":["Text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (M.S.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Colorado School of Mines"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["augmented reality","human-robot interaction","AR/VR","mixed reality","human-computer interaction"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]},{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright of the original work is retained by the author."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["Tran_mines_0052N_11979.pdf","T 8955"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/11124/174146"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Includes bibliographical references.","2020 Spring."]},{"key":"dc:description.abstract","label":"Abstract","values":["Research has shown that the use of physical deictic gestures such as pointing and presenting by robots enables more effective and natural human-robot interaction. However, not all robots come equipped with gestural capabilities. Recent advances in augmented reality (AR) and mixed reality (MR) provide powerful new forms of deictic gestures in human-robot communication. My thesis focuses on allocentric mixed reality gestures, in which target referents are picked out in fields of view of human teammates using AR visualizations such as circles and arrows, especially when these gestures are paired with verbal referring expressions and deployed under various types of mental workload of human teammates. We also present a software architecture that enables mixed reality gestural capabilities, and present the results of a human subject experiment that measures user objective performance and their subjective responses. These results demonstrate the trade-offs between different types of mixed reality robotic communication under different levels of user workload. The findings of this study suggest that although humans may not notice differences, the manner of load a user is under and the type of communication style used by a robot they interact with do in fact interact to determine their task time. The data collected from my experiment is a first step towards answering this overarching question: How can a robot select the most effective communication modality given information regarding its human teammate's level and type of mental workload?"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["born digital","masters theses"]},{"key":"dc:title","label":"Title","values":["Exploring mixed reality robot communication under different types of mental workload"]}]}],"canonical_facts":{"dc:contributor.advisor":["Williams, Thomas"],"dc:contributor.committeemember":["Camp, Tracy","Hirshfield, Leanne"],"dc:creator":["Tran, Nhan"],"dc:date.accessioned":["2020-06-07T10:14:45Z","2022-02-03T13:19:51Z"],"dc:date.available":["2020-06-07T10:14:45Z","2022-02-03T13:19:51Z"],"dc:date.issued":["2020"],"dc:description":["Includes bibliographical references.","2020 Spring."],"dc:description.abstract":["Research has shown that the use of physical deictic gestures such as pointing and presenting by robots enables more effective and natural human-robot interaction. However, not all robots come equipped with gestural capabilities. Recent advances in augmented reality (AR) and mixed reality (MR) provide powerful new forms of deictic gestures in human-robot communication. My thesis focuses on allocentric mixed reality gestures, in which target referents are picked out in fields of view of human teammates using AR visualizations such as circles and arrows, especially when these gestures are paired with verbal referring expressions and deployed under various types of mental workload of human teammates. We also present a software architecture that enables mixed reality gestural capabilities, and present the results of a human subject experiment that measures user objective performance and their subjective responses. These results demonstrate the trade-offs between different types of mixed reality robotic communication under different levels of user workload. The findings of this study suggest that although humans may not notice differences, the manner of load a user is under and the type of communication style used by a robot they interact with do in fact interact to determine their task time. The data collected from my experiment is a first step towards answering this overarching question: How can a robot select the most effective communication modality given information regarding its human teammate's level and type of mental workload?"],"dc:format.medium":["born digital","masters theses"],"dc:identifier":["Tran_mines_0052N_11979.pdf","T 8955"],"dc:identifier.uri":["https://hdl.handle.net/11124/174146"],"dc:language":["English"],"dc:language.iso":["eng"],"dc:publisher":["Colorado School of Mines. Arthur Lakes Library"],"dc:rights":["Copyright of the original work is retained by the author."],"dc:subject":["augmented reality","human-robot interaction","AR/VR","mixed reality","human-computer interaction"],"dc:title":["Exploring mixed reality robot communication under different types of mental workload"],"dc:type":["Text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Masters"],"thesis:degree_name":["Master of Science (M.S.)"],"thesis:institution_name":["Colorado School of Mines"]},"updated_at":"2026-07-24T01:42:11Z"}