{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/35513"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/35513","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"The User-Reported Critical Incident Method for Remote Usability Evaluation","abstract":"Much traditional user interface evaluation is conducted in usability laboratories, where a small number of selected users is directly observed by trained evaluators. However, as the network itself and the remote work setting have become intrinsic parts of usage patterns, evaluators often have limited access to representative users for usability evaluation in the laboratory and the users' work context is difficult or impossible to reproduce in a laboratory setting. These barriers to usability evaluation led to extending the concept of usability evaluation beyond the laboratory, typically using the network itself as a bridge to take interface evaluation to a broad range of users in their natural work settings. The over-arching goal of this work is to develop and evaluate a cost-effective remote usability evaluation method for real-world applications used by real users doing real tasks in real work environments. This thesis reports the development of such a method, and the results of a study to: • investigate feasibility and effectiveness of involving users with to identify and report critical incidents in usage • investigate feasibility and effectiveness of transforming remotely-gathered critical incidents into usability problem descriptions • gain insight into various parameters associated with the method.","abstract_html":"Much traditional user interface evaluation is conducted in usability laboratories, where a small number of selected users is directly observed by trained evaluators. However, as the network itself and the remote work setting have become intrinsic parts of usage patterns, evaluators often have limited access to representative users for usability evaluation in the laboratory and the users' work context is difficult or impossible to reproduce in a laboratory setting. These barriers to usability evaluation led to extending the concept of usability evaluation beyond the laboratory, typically using the network itself as a bridge to take interface evaluation to a broad range of users in their natural work settings. The over-arching goal of this work is to develop and evaluate a cost-effective remote usability evaluation method for real-world applications used by real users doing real tasks in real work environments. This thesis reports the development of such a method, and the results of a study to: • investigate feasibility and effectiveness of involving users with to identify and report critical incidents in usage • investigate feasibility and effectiveness of transforming remotely-gathered critical incidents into usability problem descriptions • gain insight into various parameters associated with the method.","abstract_has_math":false,"creators":["Castillo, Jose Carlos"],"institution":"Virginia Tech","degree_name":"Master of Science","degree_level":"masters","degree_discipline":"Computer Science","degree_department":"Computer Science","school":null,"contributors":[],"advisors":[],"committee_chairs":["Hartson, H. Rex"],"committee_members":["Williges, Robert C.","Hix, Deborah S.","Rosson, Mary Beth"],"year":1997,"date_issued":"1997-07-30","date_published":"1997-07-30","updated_at":"2026-07-22T22:20:25Z","subjects":["post deployment","user-reported","remote usability method","usability method","remote usability evaluation","usability data","user-initiated","critical incidents"],"languages":[],"rights":["In Copyright"],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-102798-105851"],"render_values":[{"text":"etd-102798-105851","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/10919/35513","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Hartson, H. Rex"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Williges, Robert C.","Hix, Deborah S.","Rosson, Mary Beth"]},{"key":"dc:contributor.department","label":"Department","values":["Computer Science"]},{"key":"dc:creator","label":"Author","values":["Castillo, Jose Carlos"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2014-03-14T20:47:07Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2014-03-14T20:47:07Z","2000-01-29"]},{"key":"dc:date.issued","label":"Date","values":["1997-07-30"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["post deployment","user-reported","remote usability method","usability method","remote usability evaluation","usability data","user-initiated","critical incidents"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-102798-105851"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10919/35513"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Much traditional user interface evaluation is conducted in usability laboratories, where a small number of selected users is directly observed by trained evaluators. However, as the network itself and the remote work setting have become intrinsic parts of usage patterns, evaluators often have limited access to representative users for usability evaluation in the laboratory and the users' work context is difficult or impossible to reproduce in a laboratory setting. These barriers to usability evaluation led to extending the concept of usability evaluation beyond the laboratory, typically using the network itself as a bridge to take interface evaluation to a broad range of users in their natural work settings. The over-arching goal of this work is to develop and evaluate a cost-effective remote usability evaluation method for real-world applications used by real users doing real tasks in real work environments. This thesis reports the development of such a method, and the results of a study to: • investigate feasibility and effectiveness of involving users with to identify and report critical incidents in usage • investigate feasibility and effectiveness of transforming remotely-gathered critical incidents into usability problem descriptions • gain insight into various parameters associated with the method."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Master of Science"]},{"key":"dc:title","label":"Title","values":["The User-Reported Critical Incident Method for Remote Usability Evaluation"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Hartson, H. Rex"],"dc:contributor.committeemember":["Williges, Robert C.","Hix, Deborah S.","Rosson, Mary Beth"],"dc:contributor.department":["Computer Science"],"dc:creator":["Castillo, Jose Carlos"],"dc:date.accessioned":["2014-03-14T20:47:07Z"],"dc:date.available":["2014-03-14T20:47:07Z","2000-01-29"],"dc:date.issued":["1997-07-30"],"dc:description.abstract":["Much traditional user interface evaluation is conducted in usability laboratories, where a small number of selected users is directly observed by trained evaluators. However, as the network itself and the remote work setting have become intrinsic parts of usage patterns, evaluators often have limited access to representative users for usability evaluation in the laboratory and the users' work context is difficult or impossible to reproduce in a laboratory setting. These barriers to usability evaluation led to extending the concept of usability evaluation beyond the laboratory, typically using the network itself as a bridge to take interface evaluation to a broad range of users in their natural work settings. The over-arching goal of this work is to develop and evaluate a cost-effective remote usability evaluation method for real-world applications used by real users doing real tasks in real work environments. This thesis reports the development of such a method, and the results of a study to: • investigate feasibility and effectiveness of involving users with to identify and report critical incidents in usage • investigate feasibility and effectiveness of transforming remotely-gathered critical incidents into usability problem descriptions • gain insight into various parameters associated with the method."],"dc:description.degree":["Master of Science"],"dc:identifier.other":["etd-102798-105851"],"dc:identifier.uri":["http://hdl.handle.net/10919/35513"],"dc:publisher":["Virginia Tech"],"dc:rights":["In Copyright"],"dc:rights.uri":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["post deployment","user-reported","remote usability method","usability method","remote usability evaluation","usability data","user-initiated","critical incidents"],"dc:title":["The User-Reported Critical Incident Method for Remote Usability Evaluation"],"dc:type":["Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:20:25Z"}