1. NERC PER-005 Overview May 10, 2010

2. Who, What, When, Where, Why WHO: RC, TOP, BA WHAT: –R1: Systematic Approach to Training –R2: Verify operator capabilities –R3: EOPs training (change to 12-month, not calendar) –R3.1 Simulation Technology WHEN: –R1 – 1st day of calendar quarter 24 months after final approval. –R2 – 1st day of calendar quarter 24 months after final approval –R3 – 1st day of calendar quarter past final approval –R3.1 – 1st day of calendar quarter 36 months after final approval WHERE: US & Canada WHY: create operators capable of independent operation of BES

3. NERC PER-005-1 A. Introduction 1. Title: System Personnel Training 2. Number: PER-005-1 3. Purpose: To ensure that System Operators performing real-time, reliability-related tasks on the North American Bulk Electric System (BES) are competent to perform those reliability related tasks. The competency of System Operators is critical to the reliability of the North American Bulk Electric System. 4. Applicability: 4.1. Functional Entities: 4.1.1 Reliability Coordinator. 4.1.2 Balancing Authority. 4.1.3 Transmission Operator.

4. NERC PER-005-1 R1. Each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall use a systematic approach to training to –establish a new (or modify) an existing training program(s) –for the BES company-specific reliability-related tasks –performed by its System Operators.

5. Analysis Design Development Implementation Formative Evaluation Summative Evaluation Systematic Approach to Training ADDIE MODEL

6. Analysis Design Development Implementation Evaluation Why instruction is needed What instruction is needed (general or macro level) What instruction is needed (competencies & objectives) When instruction is accomplished (assessments) How instruction is accomplished (learning strategies) What materials & media How learning transfer is delivered (delivery) What changes need to occur Systematic Approach to Training ADDIE MODEL - Outcomes

7. ADDIE PHASE Step 1Step 2Step 3Step 4Step 5 Analyze Analyze JobSelect tasksConstruct Performance Measures Analyze existing courses Select instructional setting Design Develop Objectives Develop Tests Describe entry behavior Determine Sequence & Structure Develop Specify Learning Activities Specify instructional management plan Review/ Select Training Materials Develop Instruction Validate Instruction Implement Instructional Mgt Plan Conduct Instruction Evaluate Conduct Internal Evaluation Conduct External Evaluation Revise System Systematic Approach to Training ADDIE MODEL – Instructor Activities

8. NERC PER-005-1 R1.1. Each Reliability Coordinator, Balancing Authority, and Transmission Operator shall create a list of BES company-specific reliability-related tasks performed by its System Operators.

9. NERC PER-005-1 R1.1.1. Each Reliability Coordinator, Balancing Authority, and Transmission Operator shall update its list of BES company-specific reliability-related tasks performed by its System Operators at least annually to identify new or modified tasks for inclusion in training

10. JTA: Hierarchical Method Switchman Trainer job position

11. JTA: Process Flow Method Step 3.1.1 Step 3.1.2 Step 3.1.3Step 3.1.4Step 3.1.5 3.1.2. Shift Leader reviews Switching order for accuracy. Prioritizes based on notation from Outage Coordination Team.

12. JTA: FAST Method

13. JTA: Task Decomposition Task (element) PurposeCue (for element) DecisionActionDisplaysCon- trols Feed back Likely Errors Check primary circulators have stopped Avoid pumping out water if the circuit is breached Trip sheet If any are still opera ting, stop them manually Turn off manually after 20 seconds Mimics at top of Panel F should be positioned horizontally. Ammeters should indicate no current Key Protected knobs at right side of desk E Mimics should change. Ammeters should show no current Step missed. Mimics Misread Wrong dials read. Ammeters not checked Power Plant Operator Example

14. NERC PER-005-1 R1.2. Each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall design and develop learning objectives and training materials –based on the task list created in R1.1.

15. Specifies a single outcome Observable & Measurable Describes learner’s performance Three parts: –measurable verb –important condition (if any) –criterion of acceptable performance (standard). Learning Objective

16. Objectives Sub-Tasks Tasks Duty Learning Objectives

17. Learning Objectives - Cognitive Levels (Jim Bowles – ERCOT) Evaluate the SPP process for tag approval. Modify the SPP tag process to accommodate current hour purchases. Determine the status of a tag. Analyze tag content. Validate (apply the rules) tag source and sink. Explain source/sink requirements Distinguish tag source and sink Define tag source. State the contents of a tag path

18. Systematic Approach – match the following: Objectives, Learning Activity, Assessment Objective Activity Assessment Evaluate Modify Experimentation Scorecard Determine Analyze Exercise Short Answer Validate Explain Group Fill-in-the-blank Discussion Distinguish Multiple choice Define Hands-on True/False State Tell Table created by John Taylor, NERC

19. Example: “Coordinate a system response to a major disturbance” Resources / References Terminal Objective 2: Given a significant loss of generation (double generator contingency), determine actions required using Real-Time Contingency Analysis results. Enabling Objective Learning Experience AssessmentExpected Duration DeveloperInstructor Identify and verify the generation lost indicated by a unit trip alarm on EMS. Demonstration of verifying significant loss of generation. Simulation of a significant generation loss on DevEMS. DevEMS Alarm Display, Site- over Display, State Estimator, and Outage Scheduler. 30 minutes 60 minutes Wayne Bert Wayne John Trainee verifies and identifies the unit tripped and that ICCP links are up. Table created by John Taylor, NERC

20. NERC PER-005-1 R1.3. Each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall deliver the training established in R1.2.

21. Task: Interpret SCADA generated alarms and information.

22. NERC PER-005-1 R1.4. Each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall conduct an evaluation of the training program established in R1, –to identify any needed changes to the training program

23. Program Evaluation not just individual course evaluations look at qualification program look at continuing education program how are new needs identified how are these needs addressed in training how effective is training that occurs what impact on individual performance what impact on team performance what measures used

24. NERC PER-005-1 R2. Each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall verify each of its System Operator’s capabilities to perform each assigned task identified in R1.1. –at least one time.

25. NERC PER-005-1 R2.1. Within six months of a modification of the BES company-specific reliability-related tasks –each Reliability Coordinator, Balancing Authority, and Transmission Operator –shall verify each of its System Operator’s capabilities to perform the new or modified tasks.

26. NERC PER-005-1 R3. At least every 12 months each Reliability Coordinator, Balancing Authority, and Transmission Operator shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics (which includes system restoration) using training, drills, exercises, and hands on training using simulators.

27. NERC PER-005-1 R3.1. Each Reliability Coordinator, Balancing Authority and Transmission Operator that has operational authority or control over Facilities with established IROLs or has established operating guides or protection systems to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator, virtual technology, or other technology that replicates the operational behavior of the BES during normal and emergency conditions.