1. DRAFT1 JSC PEB Safety Evaluation Process Enhancements Objective: To improve consistency of PEB Safety Evaluations across the Center

2. DRAFT 2 Challenge Measurement criteria had been consistent in safety evaluation… However, metrics interpretation and influence of anecdotal data has resulted on occasion in inconsistent scoring NS tasked to clarify safety evaluation process to: Guide consistent interpretation of injury metrics Provide flexibility in considering subjective elements, anecdotal evidence, and circumstances surrounding safety performance Solidify roles – Safety as a consulting resource COTR as ultimately responsible for performance scoring

3. DRAFT 3 Safety Evaluation Score Card – Factors Affecting Safety Score Zero 100% Safety Program Innovations Established, Proactive Safety Program Injury/Illness Rates Below Industry Average * Injury/Illness Rates Above Industry Average Safety Leadership Employee Involvement >$1M Damage Fatality $250K to $1M Damage Perm Disability Severe Mgmt Deficiencies Zero Injuries or Well Below (>74%) Industry Average Goodest Accckkk!! * Days away case rate must be <50% of ind. avg.

4. DRAFT 4 PEB Safety Evaluation Process S&MA TMR briefs S&MA PEB Rep & NA prior to PEB “Balanced Safety Score Card” S&MA PEB Rep briefs S&MA Director/Deputy Director on PEB results Performance Evaluation Board Meeting Fee Determination Official Meeting End of Performance Period S&MA Rep on PEB S&MA Director/Deputy Director at each FDO Meeting COTR and S&MA TMR Collaborate on overall Safety Evaluation Contractor mishaps/rates and other relevant safety data Assessment NS provides safety metrics summary and metrics adjective rating

5. DRAFT 5 Example Safety Metrics – What NS Scores A B

6. DRAFT 6 Safety Evaluation Score Card – Safety Metrics Scoring EXCEEDS (x3)MEETS (x2) DOES NOT MEET (0) Weighted ScorePerformance Level 3009 2108 1207 2016 0306 1115 0214 1023 0122ACCCCCKKK!!! 0030 A B Other metric factors are evaluated to determine overall safety metrics adjective rating: Type A & B Mishaps OSHA Violations Rate History Correctness/timeliness of mishap/288 reporting Size of contract C Safety provides final metrics strengths/weaknesses and a proposed adjective rating to COTR and/or S&MA TMR Adjective Rating of metric scores determined by matrix of exceeds, meets & dnm Goodest Accckkk

7. DRAFT 7 “Balanced Safety Scorecard” CategoryExpectationStrengthsWeaknesses Leadership “Safety” is an integral part of great leadership – “leadership” is an integral part of an effective safety & health program Provided by S&MA TMR and COTR Prevention You must have a S&H Program that meets the requirement of the JSC S&H Handbook (i.e. a pro-active, leadership and employee involvement based S&H Program) Provided by S&MA TMR and COTR Reaction (Trailing Indicators) NOTE: Zero injuries/illnesses may only mean that you are either lucky or under-reporting. Zero by itself has no meaning – it does have meaning, however, if there is a proactive S&H Program You are expected to achieve injury/illness rates below the industry average and to keep trying to reduce them to zero Provided by NS - based on metrics as compared to industry averages and other metric factors (e.g. type A mishaps) Issues Manage “issues” and implement appropriate risk mitigation/control and corrective action. Provided by S&MA TMR and COTR C “Reaction” (Safety Metrics) performance rating -- Based on data provided and injury/illness performance, Safety (NS) recommends a rating of ___________. This rating is only a portion of the overall safety score – other factors (Leadership, Prevention & Issues) and circumstances will determine the overall safety score.

8. DRAFT 8 Example Case – NS to COTR Phase EXCEEDS (x3)MEETS (x2) DOES NOT MEET (0) Weighted ScorePerformance Level 1115SORTA GOOD A B Other metric factors are evaluated to determine overall safety metrics adjective rating: Type A & B Mishaps – NONE OSHA Violations – NONE Rate History – TRENDING UP Correctness/timeliness of 288 reporting – ONLY HALF ACCEPTABLE Consider size of contract and circumstances of mishaps/injuries No compelling metric influence to deviate from “sorta-GOOD” C NS provides recommended adjective rating to COTR

9. DRAFT 9 Issues: corrective action delays poor safety/health compliance in planning or operations Example Case – COTR to PEB/FDO Phase In addition to metrics data provided, “Balanced Scorecard” must be developed and considered in scoring. Example “Balanced Scorecard” considerations: Leadership – Substantive actions taken by management to: Address specific injury categories; Lead supervisors through injury preventive exercises, activities, or training; Support and/or participate in employee awareness campaigns Prevention – Proactive programs with measurable impact on injury/mishap reduction – Actions based on close call trending; Improvement activities based on employee inputs mishaps or compliance problems in which NASA influence was a significant factor

10. DRAFT 10 Definitions Mishaps Type A: Fatality or hospitalization of 3 or more employees and property damage >1M Type B: Hospitalization of 2 or less employees and property damage 250K Type C: Days Away Cases and property damage of 25K Incident: Restricted Duty Case, Medical treatments and property damage of <1K OSHA Recordable All work related deaths and illnesses, and those work-related injuries which result in: Loss of consciousness, restriction of work motion, transfer to another job, or require medical treatment beyond first aid. Lost workday case – cases which involve days away from work (beyond the day of the initial injury/illness) due to a work-related injury or illness. Restricted duty case – cases that result in the employee not being able to physically or mentally perform all or any part of his or her normal assignment during all or any part of the workday or shift. Medical treatment case – includes treatment of injuries or illnesses administered by physicians, registered professional personnel, or lay persons. Medical treatment does not include first aid treatment (one-time treatment and subsequent observation of minor scratches, cuts, burns, splinters, and so forth, which do not ordinarily require medical care) even though provided by a physician or registered professional personnel. Rates Rate/indicator is the number of recordable injuries and illnesses occurring among a given number of full- time workers (100 full time workers) over a given period of time Property Damage Dollar value acquire in resulting of a mishap and close calls Violations from OSHA/EPA Non conformance citations

11. DRAFT 11 Definitions LWDC frequency rate (Days Away) – (Type C) Rate Description: This rate measures the number of injuries which result in lost time (days away from work). Rate Formula: LWDC (DA)= # of Days Away injuries x 200,000 hours / Total Work Hours Interpretation: Rate is considered an indicator of safety and health performance. Lower rate indicates a better the performance in safety and health. NOTE: Higher rate may indicate a less effective case management program. LWDC frequency rate (Days Away and Restricted Case) Rate Description: This rate measures the number of injuries which resulted in lost time (days away from work) and restricted duty case Rate Formula: LWDC (DA &RD)= (# of Days Away injuries + # of Restricted Duty cases x 200,000 hours) / Total Work Hours Interpretation: Rate is considered an indicator of safety and health performance. Lower rate indicates a better the performance in safety and health. OSHA Recordable frequency rate (Days Away, Restricted Case & Medical Treatments) Rate Description: This rate measures the number of injuries which resulted in lost time (days away from work), restricted duty cases and medical treatments Rate Formula: OSHA Recordable (DA, RD & MT) = (# of Days Away injuries + # of Restricted Duty + Medical Treatments cases x 200,000 hours) / Total Work Hours Interpretation: Rate is considered an indicator of safety and health performance. Lower rate indicates a better the performance in safety and health.

12. DRAFT 12 Comment? Contact one of the following by Nov. 3 E.w.gremillion@nasa.gov David.t.loyd@nasa.gov Gail.l.skowron@nasa.gov