Scenario-Based Task Design for Airline Pilot Anticipatory Behaviors: Asynchronous Assessment of Complex Cognitive Skills

Abstract

In airline operations, pilots are asked to actively produce positive safety outcomes and to learn from their own and others’ successes. They do this, in part, by monitoring conditions present on each flight and either reacting to or proactively planning for threats to airplane safety. However, there are few ways to assess these anticipatory and monitoring behaviors, and little is understood about how to train these complex cognitive skills. Pilots have historically learned these skills informally from peers or from personal experience. The current study seeks to both assess monitoring and anticipation and evaluate a short tutorial for advancing awareness of these skills, especially amongst early-career pilots. Scenario-based tasks were designed to assess these skills at multiple points along a flight path and were tested in a pre-test – intervention – post-test design. The design of the items and early impressions of the data are described here.

Authors

• Melissa Peterson San Jose State University
• Barth Baron Jr San Jose State University
• Lucas Cusano Ames Research Center
• Randall J Mumaw San Jose State University
• P Christine Corry San Jose State University
• Daniel Hoffman University of Hawaiʻi at Mānoa
• Dorrit O Billman Ames Research Center

Keywords

• airline sfety
• sense making
• scenario-based assessment