A Software Framework for Out-of-turn Interaction in a Multimodal Web Interface

Multimodal interfaces are becoming increasingly important with the advent of mobile devices, accessibility considerations, and novel software technologies that combine diverse interaction media. This thesis investigates systems support for web browsing in a multimodal interface. Specifically, we outline the design and implementation of a software framework that integrates hyperlink and voice interaction. This enables the user to engage in out-of-turn interactions to personalize access at an information site. For the developer, the framework enables the creation of sites that adapt to the needs of users, yet permits fine-grained control over what interactions to support. Design methodology, implementation details, and two case studies are presented.

Name thesis:degree_name

Master of Science

Level thesis:degree_level

masters

Discipline thesis:degree_discipline

Computer Science

Department dc:contributor.department

Computer Science

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2003

Author dc:creator

• Shenoy, Atul

Chairs dc:contributor.committeechair

• Ramakrishnan, Naren
• Varadarajan, Srinidhi

Committee member dc:contributor.committeemember

• Pérez-Quiñones, Manuel A.

• dialog management
• out-of-turn interaction
• mixed-initiative interaction
• multimodal interafaces

Statement dc:rights

• In Copyright

Licence dc:rights.uri

• http://rightsstatements.org/vocab/InC/1.0/

Dc Identifier Other

etd-06172003-210140

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/33619