曝光臺 注意防騙 網曝天貓店富美金盛家居專營店坑蒙拐騙欺詐消費者

Agreement on Individual Items (1-2 hours)
1. For the agreement data, the facilitator should begin with a 1-sentence definition of agreement and then explain why it is important. Then, examples of good and poor agreement should be presented to the group.
2. Following this, the low agreement (below benchmark) items for each tape segment or event set should be discussed and resolved. For each tape segment or event set, low agreement items may include observable behaviors, skill or topic ratings, overall ratings of CRM or technical performance, and/or ratings of the pilots.
For each low-agreement item, an overhead graph showing the disagreement should be presented. Then, the following questions should be asked:
Did the raters SEE the same thing?
Did the raters INTERPRET the same behaviors the same way?
Did the raters JUDGE the behavior the same way using the scale? Possible sources of divergent judgments must be explored. These could include: poor videotape quality; ambiguous wording of judgment items; unclear judgment criteria; or different judgment processes by the IEs.
In general, the IEs should work to achieve consensus on each item. Company policies, flight standards, or other issues may surface during this discussion. One team member should document the IEs’comments and input using the Feedback and Discussion Worksheet so that problems and ideas that are generated during the discussion session can be used in the future. At the end, thank the IEs for their efforts.
Section 5: Optional Post-Training IRR Check
Section 5 should begin when the group discussion has ended. This section includes rating new video segments, and meeting (the next day) to discuss them.
1. IEs view new tape segments in the same fashion as before.
2. Team analyzes these new data, and provides individual and group-level feedback as before (overnight or next day).
3. Individual feedback packets are distributed to the IEs the next day.
4. Facilitator presents pre- and post-training IRR results (see sample pre/post form below). As a group, the facilitator and the IEs decide on priorities for the next IRR session.
Average Consistency Rating  Average Congruency Rating  Average Systematic Differences  Average Agreement Rating  Average Sensitivity Rating 
Day 1 
Day 2 

To demonstrate the effect of training, the numbers in the “Day 2” row should be (statistically) larger than the numbers in the “Day 1” row.
Section 6: Dissemination of Summary Document
Immediately after the IRR training session, one team member needs to revise and summarize the IE comments/suggestions solicited during the Feedback and Discussion session. This information should then be distributed to all of the IEs. This will serve to improve the clarity of judgment criteria and judgment processes among IEs. In addition, all key training and management personnel should receive this information so that they can address unresolved rating issues that need to be managed under their authority (e.g. rewording of LOE items, clarification of policy)
　
中國航空網 www.k6050.com
航空翻譯 www.aviation.cn
本文鏈接地址：Developing Advanced Crew Resource Management (ACRM) Training: A Training Manual(109)