Corrective Action Programs

2 HSEEP Homeland Security Exercise and Evaluation Program Provides a common exercise policy and program guidance that constitutes a national standard for exercises. Capabilities and performance based program Vol. III – Exercise Evaluation and Improvement Planning

3 HSEEP Designing good exercises require: Time Effort Resources Strategy Do we devote the same to following up?

4 Exercise Evaluation Evaluation is the fundamental link to improvement. Evaluation is analytical process to assess the demonstration of capabilities: –Task-level analysis –Activity-level analysis –Capability-level analysis

5 Exercise Evaluation Benefits of a good evaluation: Identify if exercise objectives were met. Identify necessary improvements in the EM/BC program. Identify needed improvements in the plans, procedures and policies. Identify training and staffing deficiencies. Identify needed equipment. Identify need for continued exercise program.

6 Exercise evaluation Exercise methodology Evaluation team structure Exercise objectives – SMART Evaluation tools

7 Exercise Evaluation Observe exercise and collect data Evaluators –Observe and document actions –Remain unobtrusive –Collect supplemental data Conduct player hot wash –Provides for self-assessment by players –ASAP –Utilize feedback forms

8 Exercise Evaluation Analyze data Critical to discover not only what happened, but why events happened the way the did. Each task that did not occur offers an opportunity to discover a root cause Begin to develop initial analysis of the exercise –Is there a difference between observed and expected actions? –What is the consequence of that difference? –What should be learned from that consequence? –What improvements should be made?

9 AAR AAR – After action report serves two primary functions Captures the evaluation Makes recommendations for improvements

10 AAR Develop draft AAR Provides description of what happened Describes best practices or strengths Identifies areas for improvement Provides recommendations for improvement

11 AAR AAR format Report cover Administrative handling instructions Contents Executive summary Exercise overview Exercise design summary Analysis of capabilities Conclusion

12 AAR AAR format Appendixes –Improvement plan –Lessons learned –Participant feedback summary –Exercise events summary –Performance ratings –Acronyms

13 IP IP – Improvement plan identifies corrective actions, responsibilities for implementation and a timeline for implementation After action conference Identify corrective actions for implementation Finalize AAR/IP Track implementation

14 AAR/IP Final versions of the AAR and IP should be released together. The AAR/IP are critical as a tool to establish consensus and buy-in on the exercise program as an element of preparedness

15 HSEEP Benefits of consistent formatting Consistency provides for enhanced information sharing (lessons learned) between entities. Consistency provides for better understanding of roles and responsibilities between organizations. Consistency provides for a broader view of overall capabilities. Consistency provides for better exercise-to- exercise evaluation.

16 Should I Use HSEEP? Government entities use HSEEP Consistent with NFPA 1600 guidance Check with regulatory and insurance requirements Does it meet my organizations needs?