A mobile phone GuiDE : a GUI Decoder and Enricher

Much information can be obtained from knowing what tasks the user does on his or her cell phone. This paper describes GuiDE, an automated user-activity recognition system on the mobile phone. GuiDE's unique approach to activity recognition exploits GUI screenshots taken as the individual interacts with their cell phone. These screenshots are aggregated into a graph to help probabilistically determine whether or not a set of screenshots can be considered a user-level activity. A frequency count of different sets of screenshots is also kept to act as a sanity check against the probabilistic result. GuiDE is just a partial step towards a much more powerful tool that can correlate GUI information with other services to provide a better understanding of user activity.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2006

Author dc:creator

• Yan, Emily Z

Advisor dc:contributor.advisor

• Larry Rudolph.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/42123

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/42123