Integrated Marketplace: Parallel Operations CWG – January 2014

IDT WEEKLY UPDATE 2

Agenda IDT Debrief IDT 1/21 Preliminary Debrief IDT 1/27 Look Ahead Analysis Dispatch Simulator Scenario Tracker Look-Ahead Schedule: Upcoming IDTs and Scenarios Reminders Weekly Updates: Release Scorecard, Migration Report, Known Issues Log 3

Deployment Test Debrief Overall the Twelfth Deployment test was a success –All of the BAs and all but 1 MP were on the call 60 min before IDT. Thank you! The final MP was contacted and joined the call. Ramp Sharing for the Jan 21 IDT: –Off (0%) for Regulation Up and Regulation Down –On at 100% for Spinning and Supplemental Reserves Another very smooth transition into test ACE controlled well Very good response from the majority of Resources providing Regulation – most of them within 5-10 MWs of their Setpoints for the majority of the test. 4 Brian Strickland

Deployment Test Debrief Natural RSS Events –Had a ~120 MW Resource trip at around 10:00 AM  SPP asked MP to deploy Emergency MW  MP followed Setpoints correctly  Slightly above L 10 due to “over-response” to the CR event –Had a ~350 MW Resource trip at around 12:30 PM  SPP requested 320 MW of contingency and the market responded appropriately  SPP will analyze Reserve Zone Limits for future large RSS events to assure continued proper response 5 Brian Strickland

Deployment Test Debrief Review of RSS Event Expectations –Entity that experiences the Resource trip submits the RSS event –SPP enters event into CRD tool –MPs should follow Setpoints to respond –Small events are handled solely through changes in Setpoints –Large events could require unit commitments  SPP will work directly with the MP to determine which units to commit in order to respond to the event 6 Brian Strickland

Deployment Test Debrief Tested BAAL Control for the entire IDT: –Tested managing the SPP BA ACE with BAAL control in place of CPS control –During this time CPS2 violations aren’t applicable –ACE dropped below SPP’s L 10 two times:  Eastern Interconnect low frequency  Actual interchange slightly below scheduled interchange –Had a.05 Hz frequency drop across interconnect during IDT  SPP managed well with no issues The e-TerraArchive application lagged in sending data from EMS to IM: –MPs may have seen differences between XML and ICCP for units in Control Mode 3 during the test –SPP was able to implement a fix successfully during the IDT 7 Brian Strickland

Deployment Test Debrief IDT Conditions –Tieline Drop at 12:15 PM  Test went well – SPP collected good data  SPP exercised normal procedures as planned  SPP came out of the test when an RSS Event occurred, but good data still collected –TARRFs of 1: Requested that MPs submit Turn Around Ramp Rate Factors of 1 –Dispatch Target Adjustment from 1:15P to 2:30P  SPP tested internal procedure and functionality for generating Setpoints differently if a severe RTBM outage were to occur  No issues for SPP or the MPs during this test –Regulation Pre-Selection details to follow –EDR Scenario: rescheduled for Jan 27 IDT 8 Brian Strickland

Deployment Test Debrief webMirroring was off again for this IDT –Overall most MPs did a better job submitting dual schedule –Only one MP not doing a good job of dual scheduling  SPP reached out to MP directly to try to remedy 9 Brian Strickland

IDT Schedule and Conditions 10 IDT DateIDT TimesConditionsNotes 1/27/147:30A-4:30P 7hr IDT begins at 8:30A Tieline Checkout Regulation Pre-selection EDR Turn Around Ramp Rate to Regular Submission Reminder: Please submit Spin/Supp as ‘Market’ 2/25/148:30A-12:30P 2hr IDT begins at 9:30A 2/28/147:00P 4hr IDT begins at 8:00P Cutover for March 1 Go-Live Brian Strickland

Dispatch Simulator – Preliminary results 11 *Scenario document on spp.org herehere – spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops 0:00 1/15 to 23:59 1/17 1/15 day was not successful. Commitments came from DBDA, DA Market, DARUC, IDRUC, and MP Self Commitments for the 16 th and 17 th as expected – MPs should have received “Production-like” commitment notifications at expected timeframes SPP will overwrite meter settlement data for the three Operating days Jan 15, 16, 17 with RTBM setpoint instructions. Alan Adams

Dispatch Simulator – Preliminary results 12 A new control flag was introduced by Alstom with the latest patch that was not set correctly. This caused Generation Actuals to not update properly during the first several hours of the test. One COP True-Up Case that affected 1/15. SPP Continued to run its NSI True-up function to maintain Marketplace NSI with EIS NSI for any missing schedules. All other aspects of the simulator were successful and SPP committed Capacity is significantly less than the EIS capacity. MPs should be able to review their commitments for reasonability and we are asking specifically for any risk for voltage issues given the SPP commitment. Alan Adams

13

14

15 Summary – Scenarios in Parallel Ops: –6 Scenarios, 2 Partial Scenarios, Dispatch Simulator Test successful:  Scenario 7 Must Offer  Scenario 28a  Scenario 15 Commitment Mismatch Part 2  Scenario 24 – success pending Settlements  Scenario 13 DDR w/ Settlements  Scenario 29 RSG  Scenario 31 BDR w/ Settlements – success pending Settlements  Scenario 36 GFA - success pending Settlements  Dispatch Simulator Test – Note: Dispatch Simulator Test occurred 12/6 – 12/9 and again 1/15 – 1/17. Summary – Retests Pending: –2 entire Scenario retests pending  Scenario 11 scheduled for 1/27  Non-Functional Testing Scenario rescheduled for 1/23 –3 individual retest requests pending Scenario Tracker as of Jan 8 Ginny Watson

Look-Ahead: Jan 23 – Jan Parallel Ops Calendar Parallel Ops Calendar on spp.org spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Settlements details on the Settlements CalendarSettlements Calendar marketplace.spp.org > Public > Settlements > Calendars Jan 23 – Jan 25 Schedule: Thurs Jan 23: CWG Fri Jan 24: No regular P Ops Meeting IDT Jan 27 Prep Call at 3P Jan 26 – Jan 31 Schedule: Ramp Sharing On Mon Jan 27: IDT Call7:30A – 4:30P, 7hr IDT begins at 8:30A Scenario 11 EDR Tues Jan 28: IDT Debrief at 3P 16.1 / 16.2 Scenario for OD Jan 29 Wed Jan 29: 16.3 Mitigation Scenario for OD Jan 29 Fri Jan 31: Regular Friday Meeting at 9A, Parallel Ops Ends Ginny Watson

Reminders 17 SPP will retest the Non-Functional Test Scenario on Jan 23 from 10P – 12A SPP will retest Mitigation Scenarios 16.1 DA and 16.2 RUC on Jan 28 for OD Jan 29 and 16.3 – RTBM on Jan 29 Any MP who wants to see results of Mitigation needs to fail the behavior test with at least one unit. Units will be picked up in the re-run. If you are interested in participating in Scenario 16.3 – RTBM Mitigation, please submit the Resource(s) you would like to see Mitigated via RMS (Parallel Ops Quick Pick) no later than Monday, Jan 27 at 12P CPT.RMS Ginny Watson

Migration and Maintenance Report 18 Migration and Maintenance Report Migration and Maintenance Report posted to spp.org spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Release Scorecard Release Scorecard posted to spp.org: spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Known Issues Log Market Trials Known Issues Log Market Trials Known Issues Log posted on spp.org spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

Market Trials Useful Resources Integrated Marketplace Parallel Operations Project Documents spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Parallel Ops Presentations, Statistics, MP Meetings Folder Parallel Ops Reference Documents Folder Scenarios in Parallel Ops Folder > Scenarios Schedule Scenarios in Parallel Ops Folder Scenarios Schedule Parallel Ops Communication Plan Parallel Ops MP Guide Parallel Ops Calendar Known Issues Log Release Scorecard Migration Report Integrated Deployment Test (as part of Parallel Ops) spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test IDT MP Guide Parallel Ops Calendar Additional documents: Settlements Calendar marketplace.spp.org > Public > Settlements > Calendars Change Tracker spp.org > Integrated Marketplace > Marketplace Documents Change Tracker Integrated Marketplace Structured/Unstructured Test Project Documents spp.org > Integrated Marketplace > Market Trials > Structured / Unstructured Test> Integrated Marketplace Structured / Unstructured Test Project Documents 19

MP CONCERNS DURING IDT 20

Concerns During IDT - Overview SPP has strived for operations during Parallel Operations and Integrated Deployment Tests to be as close to production as possible In some cases SPP has been unable, due to Market Participant or SPP actions, or non-actions to do so In these cases SPP has implemented workarounds to allow the tests to continue These workarounds have the ability to mask issues until Go-Live that SPP would have otherwise discovered in the Deployment Tests 21

Concerns – Tagging / Scheduling Dual Scheduling Issues have occurred prompting SPP to continue the NSI true-up process, which may be masking issues –A few MPs are short staffed especially since Jan 1 st and have reported an inability to submit dual schedules –Scheduling Entities without generation are either not aware or not participating in Parallel Operations and not dual scheduling –Next hour schedules are not being dual entered Schedules on DC Ties –NSI true-up works on an aggregate level. It spreads the difference between the true EIS NSI and the entered IM NSI over all AC ties with the assumption that DC ties schedules are correct. When DC ties are missing it can cause constraint calculation issues. 22

Concerns - Schedule Mismatch Example from January 8 th shows to have had around net 1526 MW difference in Marketplace for schedules Net Breakdown: 507 MW due to MISO issue that will be fixed in next market release 67 MW due to mismatch in MWs on tags entered in Marketplace vs. EIS tag 42 MW due to extra tags in Marketplace. There were several, but were fairly balanced between exports/imports; the net effect was only around 42 MWs 768 due to tags missing from Marketplace. Not entered 61 MW was due to tags that failed validation and were overridden 23

Concerns – Tagging / Scheduling Impact Once live, Market Participants that have not adjusted their business processes to adhere to Marketplace tags/scheduling business validations, may not be able to perform interchange business Testing is encouraged MP are encouraged to practice adhering to Marketplace business validations immediately 24

Concerns – Resource Offers Issues exist with MPs carrying Contingency Reserves that are not reachable within the rules and systems of the Marketplace when a unit is on Regulation control: –In EIS some MPs are allowed to stop deploying Regulation in order to serve contingency reserves - in the Integrated Marketplace this is not allowed per the protocols Ramp rates –Regulation and Contingency Ramp Rates need to match unit capability –Experience with Turn Around Ramp Rate is ongoing, but has significant impact 25

Concerns – Real Time Data Plant Shares –Some MPs have been providing data that is inconsistent with how they are modeled in the Marketplace Load Calculations –Actual Load value from Load Serving Entities has sometimes been incorrect causing error in load forecast Non-Conforming Load –Some members are not able to properly calculate and send data on the non conforming loads – in a few cases these have been significant 26

Concerns - Other Fixed Reserves must be achievable within the ramp provided Some entities entered more reserves than can be ramped in 5 or 10 minutes Delay in following ramped Setpoint due to control dead band and point resetting on 5 minute boundaries 27

Load Aggregates LMP Available via ICCP? CWG requested SPP research making LMP for certain load aggregates available via ICCP –Data is already posted to Marketplace Portal –To provide via ICCP, a new interface between the Market and ICCP systems would be required, points would be updated on a 5 minute basis. This would involve interface and testing hours Recommendation: –SPP would not recommend adding this data to ICCP since it is already on the portal 28

RTBM Availability RTBM availability during Parallel Operations official ODs –99.08% availability on average –19 of 39 days had 100% availability 29

RTBM Solution Times RTBM solution times during Parallel Operations official ODs –89.95 seconds response time on average 30

Parallel Operations Schedule Changes Changes are in RED January 17, 9:00 am – noon: Parallel Ops / Go-Live Checkpoint (no change) January 20, 3:00 pm: Pre IDT Call (no change) January 21, 7:30 am – 4:30 pm: Integrated Deployment Test - now 7 hours beginning at 8:30 a.m. January 22, 3:00 pm: Post IDT Call (no change) January 24: No Friday Parallel Ops / Go-Live Checkpoint (cancelled) January 24, 3:00 pm: Pre IDT Call January 27, 7:30 am – 4:30 pm: Integrated Deployment Test - now 7 hours beginning at 8:30 a.m. January 28, 3:00 pm: Post IDT Call (no change) 31

Parallel Operations Schedule Changes February 24, 3:00 pm: Pre IDT Call February 25, 8:30 am : 12:30 pm: Integrated Deployment test February 26, 3:00 pm: Post IDT Call February 28, 7:00 pm : Go Live Deployment 32