Unit 5:Elements of A Viable COOP Capability (cont.)  Define and explain the terms tests, training, and exercises (TT&E)  Explain the importance of a COOP TT&E program Sub-unit Objectives: Sub-unit 5i: Tests, Training, and Exercises Unit 5—Elements of a Viable COOP Capability

Definition Measures to ensure that an agency’s COOP program is capable of supporting the continued execution of its essential functions throughout the duration of a COOP situation Unit 5—Elements of a Viable COOP Capability

Create a TT&E Program  To ensure that all TT&E events share the common, overall goal of mission readiness  To provide a framework or structure for readiness activities that will ensure consistency and uniformity It is essential that COOP test, training, and exercise events be conducted as part of a program Unit 5—Elements of a Viable COOP Capability

You can achieve the goal of mission readiness by ensuring your TT&E program:  Trains COOP members in the appropriate functional areas of mission readiness  Provides opportunities for COOP members to acquire the skills and knowledge needed to perform their assigned roles on the team  Builds team unity (e.g., allows team members to meet regularly and to develop positive working relationships) Goal of TT&E Program Unit 5—Elements of a Viable COOP Capability

You can achieve the goal of mission readiness by ensuring your TT&E program (cont.):  Includes tests and exercises (to determine team readiness, verify the effectiveness of training and overall program, identify deficiencies/problems/issues requiring corrective action)  Reflects lessons learned from TT&E events and current COOP information and the training needs of your members Goal of TT&E Program (cont): Unit 5—Elements of a Viable COOP Capability

To be effective, the program must include activities representative of each of the three components:  Tests  Training  Exercises TT&E Program Defined Unit 5—Elements of a Viable COOP Capability

A test is an evaluation of a capability against an established and measurable standard.  Examples:  Communications test  Alert and notification test  Deployment test TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability

Training is instruction in core competencies and skills and the principal means by which individuals achieve a level of proficiency. Training provides the tools needed to accomplish a goal, meet program requirements, or acquire a specified capability.  Examples:  Workshops  Orientations  Seminars  Conferences  Web-based courses TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability

Exercises are events that allow participants to apply their skills and knowledge to improve operational readiness and allow planners to evaluate the effectiveness of previously conducted tests and training activities.  Examples:  Tabletop exercise  Functional exercise  Full-scale exercise TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability

Tabletop Exercise—a low-stress, slow-paced discussion of issues, plans, policies, and procedures that provides an opportunity to resolve questions of coordination and responsibility.  Application:  Useful for developing, training and testing new personnel or new operational procedures, processes, issues, relationships, and functions  Can be used at any organizational level  Relatively inexpensive, requiring only basic resources TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability

TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability Functional Exercise-a simulation of a real emergency under high-stress conditions with limited deployment of personnel or resources  Application:  Useful for testing specific functions, processes, and procedures  Test the application of seldom used resources  Can be used at any organizational level  Less expensive than a full scale exercise

TT&E Program Defined (cont): Unit 5—Elements of a Viable COOP Capability Full Scale Exercise-a simulation of a real emergency that involves an organization’s operations, plans, processes, and procedures in a stressful and realistic environment; involves the mobilization of personnel and resources.  Application:  Useful for full and realistic testing of all aspects of planning, coordination, and integration, and the demonstration of organizational functions, processes and procedures  Best used at higher/broader organizational levels due to cost, resources, and preparation required  True test of full capabilities

Why are exercises important?  Test & evaluate plans, policies, and procedures  Reveal planning weaknesses  Reveal gaps in resources  Improve intra- and inter- agency coordination & communications  Clarify roles and responsibilities  Train personnel in roles and responsibilities  Improve individual performance  Gain public recognition & support of officials  Satisfy government requirements Exercising Your COOP Unit 5—Elements of a Viable COOP Capability

TT&E activities will likely fall into one of two broad categories:  Standard, recurring events—activities conducted on a fairly regular schedule (e.g., orientations, seminars, workshops, communications tests, alert & notification drills)  Special events—activities not conducted on a regular schedule or activities for which the purpose, audience, and content change considerably each time they are conducted (these are usually exercises) A viable, effective TT&E program will consist of a standard, core group of activities supplemented by special events Structure of TT&E Program Unit 5—Elements of a Viable COOP Capability

ESTABLISHING THE BASE PROGRAM EVALUATION & CRITIQUE Review Plans, Policies, Procedures Conduct Needs Assessment Define Program Scope Select Event Types Develop Program Purpose Develop Program Schedule Establish a Corrective Action Program (CAP) Assign Tasks, Schedules & Responsibilities Monitor Corrective Action Progress Prepare Multi-Year Development Plans Identify Resources Define Objectives, Key Events, Points of Review Develop Materials (COOP TT&E Plan, Training Schedule) Prepare Facilities & Logistics Identify & Train Participants PROGRAM DEVELOPMENT Conduct TT&E Events Market TT&E Program Coordinate with Staff and TT&E Planning Group PROGRAM FOLLOW-UP PROGRAM MANAGEMENT & IMPLEMENTATION Review and Analyze Participant Questionnaires & Critiques Review Notes From Evaluators & Observers Review After-action/Evaluation Reports Program Development Process Unit 5—Elements of a Viable COOP Capability

Exercise Documents  Exercise Plan  Control Plan  Evaluation Plan  Player Handbook  After-Action Report Unit 5—Elements of a Viable COOP Capability

Exercise Documents (cont.) Exercise Plan  Is the principal plan or roadmap for the exercise  Contains:  Purpose  Objectives  Scope  Concept  Responsibilities  Scenario  Artificialities and Simulations  Management Structure  Data Collection Methodologies  Safety and Security  Administration and Logistics Information  Milestones and Schedule Unit 5—Elements of a Viable COOP Capability

Exercise Documents (cont.) Control Plan (Control Staff Instructions)  Contains:  Overview of the exercise  Exercise control structure  Roles and responsibilities of Controllers, Response/Simulation Cell members, and Evaluators  Communications directory for Controllers/Evaluators  Scenario and master scenario events list Unit 5—Elements of a Viable COOP Capability

Exercise Documents (cont.)  Evaluation Plan  Provides a framework for the evaluation effort and subsequent after-action report  Explains the evaluation process and methodology and evaluators’ responsibilities  Contains forms evaluators will complete as they observe exercise events Unit 5—Elements of a Viable COOP Capability

Exercise Documents (cont.)  Player Handbook  Is a guide for all exercise participants, especially the players  Provides an overview of the exercise concept, objectives, and schedule  Explains responsibilities of players before, during, and after the exercise  Usually contains scenario that leads up to the start of the exercise Unit 5—Elements of a Viable COOP Capability

Exercise Documents (cont.)  After-Action Report  Is developed from the information collected during and after the exercise  Includes a brief summary or overview of exercise purpose, objectives, concept, and scenario  Focuses on the accomplishment of established objectives  Describes strengths and shortcomings  Identifies requirements for corrective action Unit 5—Elements of a Viable COOP Capability

Why Evaluate?  Evaluation can identify:  Whether objectives were achieved  Needed improvements or changes in the COOP Plan and procedures  Training needs  Staffing deficiencies  Resource and equipment deficiencies or problems  Need for new policy or guidance or for revisions in existing policy and guidance Unit 5—Elements of a Viable COOP Capability

Sources of Information for Evaluation Effort  Exercise controllers  Exercise evaluators  Exercise participants 1. Evaluation forms used by evaluators and data collectors 2. Player observation or critique forms 3. Hot wash session 1. Evaluation forms used by evaluators and data collectors 2. Player observation or critique forms 3. Hot wash session Unit 5—Elements of a Viable COOP Capability

Hot Wash  Involves all exercise participants  Occurs immediately after exercise to capture initial impressions  Is a facilitated discussion  Provides data for after-action report (data collectors will record comments/discussion during Hot Wash) Unit 5—Elements of a Viable COOP Capability

Evaluation Team Meetings  Compare notes  Analyze findings  Develop accurate account of what worked and what did not  Prepare after-action report Unit 5—Elements of a Viable COOP Capability

Implementing Change  Are the procedures sound?  Are resources sufficient to support procedures and operations?  Are personnel adequately trained to follow procedures and use resources? The purpose of an exercise is not achieved until the recommendations from the evaluation effort are implemented Unit 5—Elements of a Viable COOP Capability

COOP Planning Worksheets (cont): Unit 5—Elements of a Viable COOP Capability

Questions? Questions?