Document Type


Publication Date





As tactical aircraft become increasingly complex, pilots’ cognitive resources will become increasingly strained, especially as more critical and multifaceted information is presented on Helmet Mounted Displays (HMDs). Therefore, it is critical to ensure training results in pilots learning optimal strategies for operating in this information-rich environment, including appropriate attention allocation between different dynamic, adjustable displays and efficient scan strategies. To achieve this, a performance assessment and debrief system was developed that incorporates eye tracking technology into an HMD-enabled multirole fighter simulation to capture and process gaze data to aid in diagnosing why a pilot error occurred. The system utilizes eye tracking to 1) measure attentional focus and scan patterns, 2) diagnose errors in performance and attention allocation, and 3) display performance and attention allocation summaries and mission replay overlaid with pilot scan patterns. A training effectiveness evaluation of the system was conducted with 14 Air National Guard F-16 pilots at the 180th Fighter Wing in Toledo, OH. The F-16 is a current generation multirole aircraft with complicated displays and a variety of mission data displays available for mission execution. Participants were split into two conditions, including a control group which received debriefings utilizing traditional mission replay tools and an experimental group which received debriefings which utilized pilot scan data presented in conjunction with traditional mission replay tools. Results suggest that debriefs utilizing pilot scan data have the ability to support pilots in more quickly adjusting their scan strategies to those most optimal for performance in future, more data intensive tactical fighter environments. The paper will present the system design, experimental methods and a discussion of the results and implications for training.