Developing and Maintaining General and Specific Standards
The ACRM process supports the use of both general and specific standards for the assessment of crew performance. General standards include a standard rating scale used throughout the airline and guidelines for how to assign overall ratings to the
. General standards can help improve a group’s use of the basic assessment parameters.
individual and crew performance. Specific standards are associated with observable behaviors and technical procedures. Instructor/evaluators should be informed of and trained in the use of both sets of standards.
A standard rating scale can be used across the full range of evaluation environments, from simulator sessions to line checks. This is important because using a standard rating scale can reduce the training time required to familiarize instructor/evaluators with different assessment instruments. Its use can also increase the amount of practice instructor/evaluators have with that scale, resulting in better instructor/evaluator assessment skills. The specific points of the standard rating scale should be presented, along with examples of how to rate a range of performance using that scale.
A second general set of standards includes how to formulate overall individual and crew ratings based on the ratings of specific technical and CRM items. Some airlines have general standards that address what to do in such cases as when an individual gets one unsatisfactory rating. Other airlines develop general standards for event set failure. Such standards (e.g.,
“three strikes and you’re out”) may apply to the LOFT/LOE sessions rather than specific event sets. When an instructor/evaluator group shows low rater reliability, in addition to more training there may be a need for better general standards to help the group work together on the basic steps of the assessment process.
Specific standards should also be established for all rated elements that may cause problems or may be new to the instructor/evaluators. In most cases this will include standards for the new CRM procedures. The standards are presented to the instructor/evaluators as criteria of performance that signifies the expected level of individual or crew performance. Instructor/evaluator training may start with the standard for certain elements anticipated to cause rater problems. In this process the development team should not overlook the technical items, which may have standards that for some reason are difficult to interpret or rate. In providing specific standards, developers should concentrate on the criteria for “standard performance” (note that standard performance is not the average crew performance, rather, it is the expected crew performance). If instructor/evaluators are still having problems rating a specific element, the criteria for unsatisfactory performance should be added. In most cases, criteria for Above and Below Standard can be inferred from the Standard criteria.
　
中國航空網 www.k6050.com
航空翻譯 www.aviation.cn
本文鏈接地址：Developing Advanced Crew Resource Management (ACRM) Training: A Training Manual(47)