.  
Domain knowledge;

.  
Formal training in applicable aspects of human factors or non-technical skills (e.g. Crew Resource Management);

.  
Formal training in the use and limitations of performance rating systems;

.  
Formal training in the use of the specific behavioural marker system.

11  What are prerequisites for evaluators using a behavioural marker system? Entry requirements for personnel who will serve as evaluators:
.  
Commitment to human factor’s principles;

.  
Domain knowledge;

.  
Formal training in applicable aspects of Human Factors or non-technical skills (e.g. Crew Resource Management).

12  What are necessary qualifications of evaluators?
.  
Complete initial training in behavioural marker systems;

.  
Formal assessment as competent and calibrated following behavioural marker system-training in classroom;

.  
Calibration in operational environment (e.g. training, simulator, work environment);

.  
Periodic re-calibration for continuing use of the behavioural marker system.

What should the content of behavioural marker system training be?

.  
Make explicit goals for use of the behavioural marker system;

.  
Explain the design of the behavioural marker system, as well as content and guidelines for its use;

.  
Review main sources of rater biases (e.g. hindsight, halo, recency, primacy) with techniques to be used for minimisation;

.  
Present the concept of inter-rater reliability and the methods to be used to maximise it;

.  
Illustrate and define each point of the rating scale and different levels of situational complexity with video examples, discussions, and hands-on exercises;

.  
Provide practical training with multiple examples;

.  
Include calibration with iterative feedback on inter-rater reliability score;

.  
Teach debriefing skills as appropriate;

.
Conclude with a formal assessment of rater competence. 14 How should a behavioural marker system training be structured?

.  
Minimum two consecutive days training;1

.  
An ideal group size of 8-12 people;

.  
Training follow-up (e.g. meetings, feedback via telephone) after use of behavioural marker system in operational setting;

.
Training ideally utilises video examples from the organisation. 15 What training and calibration materials should be used?

.  
Videotapes of scenarios with professional sound and visual quality;

.  
Demonstrating various levels of performance;

.  
Showing all behavioural markers in scenarios illustrating various environmental conditions and complexity;
　
中國航空網 www.k6050.com
航空翻譯 www.aviation.cn
本文鏈接地址：CAP 737 Crew Resource Management (CRM) Training 機組資源管理培訓(98)