1Source Safety and Health, Inc. Evaluation Methods and Performance Chris Schneider Colin Brigham Dan Bruun

1Source Safety and Health, Inc. Goals for Today Understand importance of: – Continuous improvement and its positive effect on performance – Identifying opportunities for increasing performance – Thinking broadly with regards to selection of evaluation methods – Connecting the presentation to your situation – Your role as a Safety Coordinator

1Source Safety and Health, Inc. Goals for Tomorrow & Beyond Lay the foundation for increasing performance by: – Evaluating your commitment to the position and responsibilities – Evaluating the commitment of your management team to safety – Develop a grand strategy for success – Develop evaluation / measurement systems – Develop goals that will increase performance

1Source Safety and Health, Inc. Evaluation Methods Topics for today include information on: – A Process of Continuous Improvement – A Statistical Approach – A Program Approach

1Source Safety and Health, Inc. Evaluation Methods and Performance A Process of Continuous Improvement Chris Schneider, CIH

1Source Safety and Health, Inc. What’s Been Done To Date? Agency Safety Coordinators Written Safety Program Program Implementation Training Programs Audits

1Source Safety and Health, Inc. Fundamental Requirement of any Safety Program Identify Need for Policies and Programs

1Source Safety and Health, Inc. What Generally Follows Identification? Develop Policy and Program Identify Measurable Goals Implement Policy and Program Evaluate Performance

1Source Safety and Health, Inc. Evaluation Compares A Groups Performance To: Baseline The Group (perhaps the best indicator) Large Pool (an agency to all agencies / private business SIC) Small Pool (an agency to a similar agency / private business SIC)

1Source Safety and Health, Inc. What Follows Performance Evaluation? Revisit Identify Issues Revise Policy and Program Revise Goals Implement Policy and Program Re-evaluate Performance

1Source Safety and Health, Inc. Let’s Talk About Continuous Improvement Gain Management Commitment and Involvement Establish a Baseline Set Goals Implement Strategies Review and Adjust

1Source Safety and Health, Inc. Gain Mgmt Commitment Establish Baseline Review and Adjust Develop & Implement Plans Set Goals Continuous Improvement Model

1Source Safety and Health, Inc. Gain Management Commitment and Involvement Communicate a vision Set performance standards Define roles and responsibilities Identify needed resources Measure and evaluate performance

1Source Safety and Health, Inc. Establish a Baseline Identify the issues Conduct a gap analysis Identify the key measurements Analyze the results Communicate the findings

1Source Safety and Health, Inc. Set Goals Set measurable improvement goals Communicate the goals

1Source Safety and Health, Inc. Implement Strategies Develop action plans to accomplish goals Carry out plans Monitor results Acknowledge success Understand shortcomings

1Source Safety and Health, Inc. Review and Adjust Build on success Re-examine failures Repeat the process Communicate the process

1Source Safety and Health, Inc. Other Issues Related To Success What Is Acceptable (Realistic) Performance? What Are Acceptable (Realistic) Time Frames? What Level of Time Commitment Do You Need? What Resource Do You Need?

1Source Safety and Health, Inc. QUESTIONS ??

1Source Safety and Health, Inc. Evaluation Methods A Statistical Approach Colin J. Brigham, CSP, CIH, CPE, CPEA, etc.

1Source Safety and Health, Inc. Why Do You Measure? Allows goal setting, creates sense of achievement Creates potential for reward Required to by BWC for self-insured's

1Source Safety and Health, Inc. What Do You Measure? Consequences – failures (injuries, illnesses, incidents and costs) Causes – work practices and work conditions Controls – accountabilities, procedures

1Source Safety and Health, Inc. What Do You Measure? To quote Albert Einstein, "Not everything that counts can be counted, and not everything that can be counted counts." A few good goals. Goals are like Marines: we only need a few good ones. Alice – “Would you tell me please, which way I want to go from here?” The Cheshire Cat – “That depends a great deal on where you want to go.”

1Source Safety and Health, Inc. Consequences - Measurement Examples Workers’ Compensation Cost Number of Claims Frequency Rate Per 1000 Employees Cost Rate Per Employee Average Cost Per Claim

1Source Safety and Health, Inc. Consequences - Measurement Examples First-aid cases Lost-time incident cases Total number of lost work days

1Source Safety and Health, Inc. Cause - Measurement Examples # Unsafe work conditions found # Unsafe work practices observed Failure to correct previous hazards Failure to address current hazards Absence of (gaps in) required programs Absence of (gaps in) accountability

1Source Safety and Health, Inc. Control - Measurement Examples Number (or %) of trained in safety and health management Number (or %) with personal goals for safety and health performance Measures that reflect special emphasis areas (e.g., ergonomics, slips and falls)

1Source Safety and Health, Inc. Control - Measurement Examples Number (or %) of incidents investigated by management/safety committees Number of days to investigate incidents Number of people trained in incident investigation

1Source Safety and Health, Inc. Control - Measurement Examples Number (or %) of presentations with safety focus Number of articles/ s on safety topics Number of safety inspections by different groups Average hazard abatement response time

1Source Safety and Health, Inc. Control - Measurement Examples Number (or %) of people having required safety training Scores on quizzes from training courses Number of safety committee meeting held Attendance at safety committee meetings Number (or %) of job hazard analyses completed

1Source Safety and Health, Inc. Data, Data, Who Has the Data? Identify sources Develop definitions Track frequently, time sensitive to task Communicate widely Stress performance improvement

1Source Safety and Health, Inc. Example of a Monthly Report: The National Safety Council Safety Management Process Measures Physical Hazard Inspections Location Goal Completed % Score A B C D

1Source Safety and Health, Inc. Data: How do you use it? Reward or punish based upon results – Prompt arrival and attendance at safety committee meetings = coffee and donuts – Incident reporting/investigation included as criteria for job performance evaluation Make program changes based upon results – Gaps: plan to fill them, do it, check results, act if more changes needed

1Source Safety and Health, Inc. Data: How do you use it? Comp Services Data: what can it tell you? – Source of injury – Nature of injury – Body part – Time of day – Time of year – Supervisor – Location

1Source Safety and Health, Inc. Data: How do you use it? Imagine PA: what can it tell you? – Any tools involved – Any mechanical defects – Unsafe act – Unsafe condition Imagine PA: what can it tell you? – Amputation – Motor vehicle accident – Safeguard provided – Safeguards used

1Source Safety and Health, Inc. What do World-Class Performers Measure? The Home Depot Allegheny Energy Delphi American Medical Response Rexnord, Inc

1Source Safety and Health, Inc. QUESTIONS ??

1Source Safety and Health, Inc. BREAK TIME BE BACK BY 10:45

1Source Safety and Health, Inc. Evaluation Methods A Program Approach Dan Bruun, CIH

1Source Safety and Health, Inc. How do you measure program effectiveness if you have no or few losses?

1Source Safety and Health, Inc. What Do We Do First? Management Vision and Commitment Safety Policy Statement Employee Involvement Goals and Objectives

1Source Safety and Health, Inc. Goals and Objectives Safety Committee Meetings Safety Inspections Investigation of Accidents and Incidents Safety Training and Awareness Employee Involvement Emergency Preparedness Program P-Elements

1Source Safety and Health, Inc. Safety Inspections Establish a regular frequency Look at all work areas Checklists for documentation Involve employees/supervisors Method for follow up

1Source Safety and Health, Inc. Accidents, Incidents, and Near Misses Investigate all incidents and near misses Identify root causes Identify facility, management and/or employee deficiencies Safety committee participates and reviews

1Source Safety and Health, Inc. Safety Suggestions Another way to get information about safety deficiencies Reviewed by Safety Committee Follow-up with employees Corrective actions

1Source Safety and Health, Inc. Safety Training and Awareness New employee orientation Training for new equipment and processes First aid and CPR, and blood borne pathogens Accident and incident investigations for Managers and Supervisors Hazard identification

1Source Safety and Health, Inc. Safety Training and Awareness Workplace violence Drug and alcohol abuse prevention and awareness Update employees on new policies and Management Directives Renew and update Safety Policy Statement

1Source Safety and Health, Inc. P-Elements Are the required programs in place? Do the written programs address the hazards in the workplace? Audit program specific elements to evaluate effectiveness

1Source Safety and Health, Inc. Evaluation of the Effectiveness of the Safety Program How are we doing? What can we do better? Compare key components to baseline, or goals

1Source Safety and Health, Inc. Evaluation of the Effectiveness of the Safety Program Observe, measure, and record Keep documentation

1Source Safety and Health, Inc. Goals and Objectives Were objectives set? Were objectives met? What roadblocks were discovered?

1Source Safety and Health, Inc. Safety Committees How many meetings? How many employees involved? Number of issues reviewed by committee?

1Source Safety and Health, Inc. Safety Inspections How many conducted? Did every work location get inspected? How many employees or % involved? How many deficiencies discovered? How many or % deficiencies resolved?

1Source Safety and Health, Inc. Accidents and Incidents How many occurred/were investigated? Direct and indirect costs? What deficiencies were discovered How many or % deficiencies resolved?

1Source Safety and Health, Inc. Safety Suggestions How many received? How many or % followed up? What deficiencies were discovered How many or % deficiencies resolved?

1Source Safety and Health, Inc. Safety Training and Awareness How many employees or % trained? How many hours of training? How many safety topics trained? How many pieces of safety information distributed? Has training addressed the hazards and/or causes of losses?

1Source Safety and Health, Inc. Emergency Preparedness Specific responsibilities assigned? Emergency drills conducted? Performance reviewed for areas of improvement?

1Source Safety and Health, Inc. P-Element Programs Programs developed where needed? Do programs control hazards? Have employees received specialized training? Do employees follow program and know what to do?

1Source Safety and Health, Inc. Comments, Questions, Experiences and Suggestions

1Source Safety and Health, Inc. LUNCH TIME PLEASE RETURN BY 12:45