Developing Advanced Crew Resource Management (ACRM) Training: A Training Manual(46)

Debriefing the LOFT/LOE
Debriefing is an essential part of the LOFT/LOE and very important in the training of CRM procedures. The modules addressing LOFT/LOE debriefing should cover the following topics:
. How an instructor should state the debriefing agenda, soliciting agenda topics from the crew on items they would like to cover.
. How an instructor can set time limits and ask the crew for their overall self-appraisal of the flight.
. How to guard against making the crew defensive and exercise patience in directing the crew to the main points of the session.
. How to integrate technical and CRM feedback into the debrief.
. How to ensure that all crewmembers participate in the discussion and effectively draw out quiet or hostile crewmembers.
. How to provide a clear summary and recap of key learning points.
Additional tips and techniques to help instructor/evaluators in the debriefing process can be included. For example, explaining how the instructor/evaluator should operate as a resource to crewmembers by highlighting different portions of the LOE that may be suitable for review, critique, and discussion can be useful. Tips on how to ensure that the discussion is led by the crewmembers can also be helpful.
LOFT/LOE debriefing has been the topic of some recent NASA and FAA funded research. One of the products of that research has been a training manual, Facilitating LOS Debriefings (McDonnell, Jobe, & Dismukes, 1997), available from NASA Ames Research Center:
Key Dismukes
NASA Ames Research Center
MS-262-4
Moffett, Field, CA 94035-1000

Developing Assessment Standards and IRR Process

. There is a high probability of rater bias, and that bias should be addressed through training.
Standardizing Crew Assessment and Inter-Rater Reliability
Another important element of ACRM instructor/evaluator training is developing and maintaining superior assessment standards. The module that addresses this set of topics should explain that LOFT/LOE crew performance assessment is based on observations by a trained instructor/evaluator (see Appendix D for facilitating an IRR training workshop). The reliability of those observations is critical to the airline in determining the performance level of its crews as well as the organizational training needs. Reliable ratings mean that all raters provide the same scores or grades to the same performance, both technical and CRM. Instructor/evaluators need to constantly maintain a high standard of reliability, something that can best be developed in a group setting. Without this high level of reliability, the crew performance score or ratings may say more about the instructor’s biases than about the crew performance being assessed.
There is a high probability of some rater bias when making crew performance assessments. The most common forms of bias that can be addressed through instructor/evaluator training are central tendency, the halo error, and leniency error. One of the most common biases in LOFT/LOE performance rating is that of central tendency, where the rater tends to rate most performance toward the middle, average, or standard point on a rating scale. The halo error occurs when raters are biased by an overall positive or negative impression of the crew rather than specific performance elements. Without training in assessment standards and IRR, raters may develop a bias toward leniency where they unintentionally rate crew performance as being higher than it really is. The instructor/evaluators should be informed of these biases and provided with training to avoid them.
　
中国航空网 www.aero.cn
航空翻译 www.aviation.cn
本文链接地址：Developing Advanced Crew Resource Management (ACRM) Training: A Training Manual(46)