BY ORDER OF THE AIR FORCE PAMPHLET 91-215 SECRETARY ...

Attachment 7
SUPERVISE AND REVIEW DETAILS AND EXAMPLES
A7.1. Introduction. Management is moving a task or an organization toward a goal. To move toward a
goal you must have three things. You must have a goal, you must know where you are in relation to that
goal, and you must have a plan to reach it. An effective set of risk matrices provides two of the elements.
A7.2. In regard to ORM, indicators should provide information concerning the success or lack of success
of controls intended to mitigate a risk. These indicators could focus on those key areas identified during
the assessment as being critical to minimizing a serious risk area. Additionally, matrices may be developed
to generically identify operations/areas where ORM efforts are needed.
A7.3. Let’s look at a representative set of risk measures that a maintenance shop leader could use to assess
the progress of his shop toward the goal of improving safety performance. Similar indicators could be
developed in the areas of environment, fire prevention, security, and other loss control areas.
A7.3.1. The tool control effectiveness index. Establish key indicators of tool control program
effectiveness (percentage of tool checks completed, items found by QA, score on knowledge quiz
regarding control procedures, etc.). All that is needed is a sampling of data in one or more of these areas.
If more than one area is sampled, the scores can be weighted if desired and rolled up into a single tool
control index by averaging them. See Figure A7.1 for the example.
Figure A7.1. Example Tool Control Effectiveness Measurement.
a. The percent of tool checks completed is 94%.
b. Items found by QA. Items were found in 2% of QA inspections (98% were
to standard).
c. Tool control quiz score is 88%.
d. If all items are weighted equally (94+98+88 divided by 3 = 93.3) then 93.3 is
this quarter’s tool control safety index. Of course, in this index, high scores
are desirable.
A7.3.2. The protective clothing and equipment risk index. This index measures the effectiveness with
which required protective clothing and equipment are being used by shop personnel. Data is collected by
making spot observations periodically during the work day. Data are recorded on a check sheet and are
rolled-up monthly. The index is the percent safe observations of the total number of observations made as
illustrated at Figure A7.2.
Figure A7.2. Example Safety Observation Measurement.
TOTAL OBSERVATIONS: 27 SAFE OBSERVATIONS: 21
The protective clothing and equipment safety index is 78 (21 divided by 27 = 78%).
In this index high scores are desirable.
113