Integrating the 1st Person View and the 3rd Person View Using a Connected VR-MR System for Pilot Training

Abstract

Verbatim from Embry-Riddle Scholarly Commons. Not paraphrased, not summarized.

Many virtual reality (VR)-based flight simulation programs provide pilots the enhanced reality from the 1st person-view to make themselves immersed in the cockpit. Using the VR simulations, pilots can take flight training in many challenging situations that are hard to create in real environments due to its natural entropy and safety concerns such as severe crosswind or engine fire. Mixed reality (MR) technology provides three-dimensional graphics so that users can effectively see all 360 degree-vertical and horizontal aspects of an object while they freely move around to see the graphics maintaining the consciousness of real space. Flight instructors may want to monitor the progress of an airplane itself above many regions from the 3rd person view as well as how the airplane’s pilot follows the desired flight procedures in the cockpit from the 1st person view. The investigators developed the prototype of a comprehensive pilot training system by connecting VR and MR that make both views available to evaluate a pilot’s flight performance from various aspects. Five flight instructors provided their feedbacks after trying the prototype system. They revealed that the prototype would provide a fast and accurate evaluation of pilot performance for novice pilots and insights to develop more economic and safer flight paths in a certain region. The function of evaluating two different perspectives for a single flight operation at the same time will provide an unprecedented advantage to the conventional training and monitoring environments that have been separated or the 2D base.

Authors

• Oh, Chang-Geun, Ph.D. Embry-Riddle Aeronautical University
• Oh, Myunghoon, Ph.D. Embry-Riddle Aeronautical University

Keywords

• virtual reality
• mixed reality
• flight simulation
• training system
• Educational Technology
• Human Factors Psychology
• Other Computer Engineering