Effect of false alarm rate on pilot use and trust of automation under conditions of simulated high risk

An experimental study was conducted to investigate the relationships between automation false alarm rate, human trust in automation, and human use of automation, specifically under conditions of simulated high risk. The experiment involved military pilots flying combat and non-combat missions while employing a missile warning sensor with two levels of automation. The experiment was performed in a high fidelity F- 16 simulator with U.S. Air Force F-16 pilots as test subjects. Three sensor false alarm rates were tested. The results showed that the level of missile warning sensor automation preferred by the pilots was strongly dependent on the false alarm rate of the automation. The data demonstrated that as false alarm rate increased, pilot trust of the missile warning sensor decreased, resulting in the pilot preferring a lower level of automation. However, the results also showed that even when pilots expressed little trust in the system, they preferred to use some level of automation rather than turn the system off. This result was attributed to the cost/benefit tradeoff of using the automation, as well as the extreme difficulty and hazard associated with the task. Analysis of the pilot mean reaction time in response to a missile warning sensor alert showed that reaction time increased as the false alarm rate increased, although this effect appeared to be less significant the higher the false alarm rate. Missile hit data indicated that as false alarm rate increased, the number of missiles that hit the pilot's aircraft also increased, demonstrating a degradation in pilot survivability. Missile hit results also indicated that using a higher level of automation improved pilot survivability for the scenarios tested.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Aeronautics and Astronautics

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

1998

Author dc:creator

• Cafarelli, Deborah A. (Deborah Ann), 1964-

Advisor dc:contributor.advisor

• R. John Hansman, Jr.

• Aeronautics and Astronautics

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/36094

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/36094