Design and evaluation of a web-based training tool for the User Action Framework Explorer

explosion in the use of computing and interactive systems of all kinds. This growth has brought with it an awareness among developers of interactive systems about the importance of user centered design and usability. In the Virginia Tech Usability tools lab, efforts are underway to develop tools and processes that assist in usability evaluation. This has led to the development of the User Action Framework (UAF) (Andre et al., 1999), a framework that forms the basis of several usability inspection tools like the Explorer, UPI (Usability Problem Inspector), UPC (Usability Problem Classifier) and the usability problem database. The UAF explorer is the tool in the toolkit, which allows users to explore and learn the structure of the UAF. The framework, in its final stages of development, is based on an interaction cycle derived from Norman's action model (1986). For its acceptance, the user action framework, which is based on human factors and cognitive concepts, needed a training program to make it accessible and understandable to the usability practioners in industry and academia. This thesis addressed the following research activities: (1) Developing a web-based training tool for the User Action Framework explorer and (2) Evaluating a web- based training tool using various formative evaluation techniques and a final summative evaluation to measure effectiveness of the training, transfer of training, knowledge/skill acquisition and reaction to the training. The summative evaluation used a pretest-posttest between subjects experimental design to determine the effectiveness of the training tool with the use of lecture-based training as a control group. The data collection included objective measures of performance and subjective measures through questionnaires and rating scales. The summative evaluation found no significant differences between gain scores on lecture-based training and web-based training under controlled conditions. Opportunities for future research were identified and the training tool is expected to contribute to the efforts of the VT usability tools lab towards educating usability professionals and researchers alike on the usefulness of the User Action Framework and its associated tools. This work also seeks to proliferate the use of web based training methods as a valuable way to train remote learners on such developing frameworks and toolkits.

Name thesis:degree_name

Master of Science

Level thesis:degree_level

masters

Discipline thesis:degree_discipline

Industrial and Systems Engineering

Department dc:contributor.department

Industrial and Systems Engineering

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2002

Author dc:creator

• Balasubramanian, Venkatramanan

Chairs dc:contributor.committeechair

• Smith-Jackson, Tonya L.
• Hartson, H. Rex

Committee member dc:contributor.committeemember

• Williges, Robert C.

• web based training
• training tool
• UAF
• User action framework
• usability
• human factors

Statement dc:rights

• In Copyright

Licence dc:rights.uri

• http://rightsstatements.org/vocab/InC/1.0/

Dc Identifier Other

etd-11182002-155635

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/35742