Gaze tracking : seeking critical information for autonomous excavation

Automating excavation in mining and construction applications is crucial today as the supply of skilled operators cannot match market demand. To efficiently make control decisions for autonomous excavators without having to take in all visual inputs from a typical operator's field of view, gaze tracking is employed in solely extracting key visual information that skilled operators use in the field. Both a front facing camera depicting the world view of the subject and two eye facing cameras that track the subject's pupil movement are worn by a subject to identify regions and features that are of high interest to operators during a digging task. Key features, such as the interface between the soil and the bucket, are characterized using U-Net, a Convolutional Neural Network designed for image segmentation. Through this study, key regions, the inside of the bucket and the opening of the bucket, as well as key features, the soil-bucket interface, were identified to be of high interest to subjects. This information can serve to identify only the necessary visual inputs in the control decision process, thus shortening computation time.

Name thesis:degree_name

Bachelor

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Mechanical Engineering

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2019

Author dc:creator

• Shiozawa, Kaymie.

Advisor dc:contributor.advisor

• Harry H. Asada.

• Mechanical Engineering.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/123268

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/123268