A Study of How Flight Instructors Assess Flight Maneuvers and Give Grades: Inter-rater Reliability of Instructor Assessments

Abstract

Verbatim from Embry-Riddle Scholarly Commons. Not paraphrased, not summarized.

This article discusses calibration of flight instruction to an academic institution’s “gold standard”. Flight instructors reviewed four lessons within the private pilot curriculum. Each lesson required rating four maneuvers and assigning an overall letter grade. Data was compared to the gold standard set by flight faculty from the institution. Initial data revealed instructors with one year or less of experience had less agreement to the gold standard. A curriculum to rate maneuvers and grade lessons was developed and practice sessions occurred in instructor meetings starting Fall 2013. Post-test results show improvement in agreement in one year or less experienced group.

Authors

• Beaudin-Seiler, Beth M Embry-Riddle Aeronautical University
• Seiler, Ryan Embry-Riddle Aeronautical University

Keywords

• Flight Training; Education; Assessment;
• Educational Assessment, Evaluation, and Research