1/22/08 CDR Presentation to TPTF - v1.1 Current Day Reports (CDR) Project Michael Daskalantonakis & Brian Cook Revised 1/26/08.

Slides:



Advertisements
Similar presentations
MISUG Meeting Materials ERCOT 10/16/ Agenda 10/16/ Antitrust AdmonitionJ. Lavas 9:30 a.m. 2.Introduction/Agenda OverviewJ. Lavas 9:35 a.m.
Advertisements

October 22, 2007 TPTF Meeting Early Delivery Systems Status Update and Forecast Daryl Cote/John Webb/John Hall.
Lead from the front Texas Nodal 1 Texas Nodal Market Management System Requirement Documents November 7, 2006 Sai Moorty MMS Project.
Lead from the front Texas Nodal 1 Texas Nodal Market Implementation Program Implementation Scenarios September 6, 2006.
Lead from the front Texas Nodal 1 EDS 3 Release 5: SCED Phase 1 Testing Aug 14, 2007.
Lead from the front Texas Nodal 1 EDS 4 Release 9.1 DAM/RUC/SASM Market Call January 11, 2008.
Lead from the front Texas Nodal 1 External Web Services Update Nodal Implementation Team Presentation July 7, 2009.
CRR Auction Scope John Moseley. To outline aspects of the CRR market process to assure that these proposed CRR market protocols (as interpreted by ERCOT.
1Texas Nodal Texas Nodal Market Trials and Data Verification ROS Meeting By Steve Grendel, ERCOT Thursday, 01/11/2007.
Lead from the front Texas Nodal 1 Texas Nodal Energy Management System Requirement Documents December 5, 2006 Jay Dondeti EMS Project.
EDS 2 Early Delivery Systems Review and Request for Approval May 2007 John Webb.
1Texas Nodal Texas Nodal Commercial Systems COMS CSD Presentation By ERCOT Wednesday, 1/10/2007.
Lead from the front Texas Nodal 1 Texas Nodal Load Frequency Control (LFC) EDS 3 Release 6 - Handbook EDS 3 Release 6 MP Planning.
Texas Nodal 1 Nodal Operations Model Posting Confirmation TAC May 7, 2009 Matt Mereness, ERCOT.
Texas Nodal Timeline Options, TPTF Jul 11, Timeline Options Trip Doggett TPTF
1Texas Nodal Nodal Day-Ahead Market Update Special NATF Meeting July 19, 2010.
ROS Meeting – 12/06/071Texas Nodal Program - TPTF Update Texas Nodal Transition Plan Task Force ROS Meeting Stacy Bridges, ERCOT Thursday, 12/06/2007.
September 8, 2008 TPTF Nodal Core Projects Updates Nodal Project Managers.
January 21, 2010 Security Constrained Economic Dispatch Resmi Surendran.
1Texas Nodal Market Trials Update. 2Texas Nodal LFC Testing Review Review of materials presented at TAC Changes in Market Trials schedule and activities.
Lead from the front Texas Nodal 1 TPTF Update for TAC March 8, 2007 Trip Doggett.
COMS Nodal Commercial Systems Project Update COPs Meeting May 2007 By Bill Barnes and Justin Rasberry.
Overview of MID, MIR, & Extracts for DEWG 9/24/07 Steve Cox.
January 15, 2008 Monthly Board of Directors Meeting Texas Nodal Market Implementation Program Update Jerry Sullivan.
1/22/08 RTR Project Presentation to TPTF RTR Project Michael Daskalantonakis & Brian Cook.
1 Market Trials Update NATF June 1, 2010.
EDS 2 Early Delivery Systems Release 3 – WebEx Conference July 10, 2007.
1 Market Trials Open Market Participant Call Weekly Kick Off March 01, 2010.
Lead from the front Texas Nodal 1 Integrated ERCOT Readiness and Transition (IRT) TPTF - November 6 th, 2006.
Nodal MIS Portal Project MIS Functions to Support EDS 3, Release 5 September 11, 2007.
September 25, 2007 TPTF Meeting Texas Nodal Program Update Jerry Sullivan.
Market Participant Data Access 1 Market Participant Data Access Jan Stephen Kerr.
Lead from the front Texas Nodal 1 TPTF Update for TAC February 1, 2007 Trip Doggett.
July 10, 2008 ROS Early Delivery Systems Status – R6.3 2 Hour Test John Dumas and Jeff Gilbertson.
Project Funding Report November 1, Business Integration Update – Agenda –Project Portfolio Updatep Revision Request Funding Reconciliation.
Appeal of PRS Action NPRR 351, Calculate and Post Projected Non-Binding LMPs for the Next 15 Minutes Floyd Trefny Texas Steel Companies.
Lead from the front Texas Nodal 1 TPTF Update for TAC March 30, 2007 Trip Doggett.
Lead from the front Texas Nodal 1 EDW Update to TPTF November 5, 2007 Janet Ply EIS Nodal EDW Project Manager.
Information Technology Report Dave Pagliai Manager, IT Support Services October 2015 ERCOT Public.
1 Tests for Reasonable LMPs & Price Validation Tool Overview October 27, 2009 NATF.
Floyd Trefny, P.E. Director of Wholesale Market Design Nodal Market Tools to Manage Wind Generation January 29, 2009 Presentation to the Renewables Technology.
Protocol Revision Subcommittee Tom Burke September 7, 2012.
1 ERCOT Pricing and Dashboard Updates NATF Sept 30, 2010.
Lead from the front Texas Nodal 1 Texas Nodal EDS 3 Early Delivery System Plan TPTF April 02, 2007.
Congestion Revenue Rights 1 Texas Nodal Market Implementation Program CRR Requirements Updates CRR Project Team – Presented by Beth.
Integrated Release Approach and Update TPTF 11/10/2008 Matt Mereness.
9/12/2006 TPTF MIS / Training Status & Update Pat Harris A portal is a web site or service that offers a broad array of resources and services such as.
Lead from the front Texas Nodal 1 EDS 3 Release 5 Monday / Friday Market Updates November 02, 2007.
Integration Update 1 External Interfaces & Integration Aug Stephen Kerr.
Lead from the front Texas Nodal 1 Texas Nodal Market Implementation Program Implementation Scenarios September 6, 2006.
October 8, 2007 TPTF Meeting Texas Nodal Program Update Jerry Sullivan Program Director, Market Redesign.
MISUG TAC Update Jackie Ashbaugh ERCOT 3/7/ TAC3/7/ /22/2011 Meeting Focus on the high priority items from MISUG: Review task list prioritization.
Lead from the front Texas Nodal 1 Texas Nodal Market Implementation Integration Update October 24, 2006 Daryl Shing, Enterprise.
Lead from the front Texas Nodal 1 High-Level Overview of draft NPRR implementing PUCT Rule Posting Requirements January 8,
August 11, 2008 Texas Nodal - Integrated Schedule Update Integrated Schedule Update for TPTF Janet Ply.
Lead from the front Texas Nodal 1 Texas Nodal EDS 4 Early Delivery System Plan TPTF May 22 nd, 2007.
Lead from the front Texas Nodal 1 Reduction of MMS Vendor Effort for TPTF January 8, 2008 Murray Nixon Sai Moorty.
Lead from the front Texas Nodal 1 Texas Nodal EDS Market Trials Approach Wednesday, November 29, 2006.
1 Project Prioritization Review May 14, Approved Revision Requests “Not Started” – Planned to Start in Future Months Revision Request Target Start.
Day-Ahead Market Discussion/Clarification TPTF April 24, 2006.
January 3, 2008 TAC Meeting Texas Nodal Program Update Jerry Sullivan.
1 Project Update and Summary of Project Priority List (PPL) Activity to Date June 11, 2014.
ROS Meeting – 06/12/081Texas Nodal Program - TPTF Update Texas Nodal Transition Plan Task Force ROS Meeting Stacy Bridges, ERCOT Thursday, 06/12/08.
EDS 3 Release 5 SCED Testing Update - TPTF Daryl Cote August 28, 2007.
6/21/2007 TPTF: Baselines 1&2 WP and CI Baselines 1 and 2 White Papers and Change Items Diran Obadina.
Lead from the front Texas Nodal 1 Texas Nodal EDS4 - Approach 11/28/2007.
Lead from the front Texas Nodal 1 Texas Nodal Energy & Market Management System EMS/MMS Projects Requirement Documents November.
Texas Nodal Program ERCOT Readiness & Transition (ERT) Supplemental Information TPTF January 12, 2009 Kevin Frankeny.
August 11, 2008 TPTF EDS Sequence and Durations Discussion Daryl Cote.
Presentation transcript:

1/22/08 CDR Presentation to TPTF - v1.1 Current Day Reports (CDR) Project Michael Daskalantonakis & Brian Cook Revised 1/26/08

2 CDR Presentation to TPTF - v1.11/22/08 Project Overview Delivering reports that are generated within 8 hours of the data being calculated by the systems, as required by the Nodal Protocols Providing an integrated system that will: –Create current day reports –Extract data items with the right latency from multiple operational source systems for use in current day reports –Provide source data traceability and report reproducibility –Offer long-term nodal report management solution (MID/MIR) that meets performance requirements Providing MP access to current day reports through: –MIS Portal –ERCOT.com or –Web Services The Current Day Reports (CDR) project is responsible for:

3 CDR Presentation to TPTF - v1.11/22/08 Scope and Dependencies Project Scope: –Obtain data with right latency from source systems –Aggregate data for current day report purposes –Format and present the report to the end-user –Archive the report per report retention policy –Search and retrieve a previously archived report Project Dependencies: –Source system staging tables (e.g., MMS, EMS) for obtaining data –MIS Portal and ERCOT.com for presenting current day reports to MP users –Web Services for ERCOT machine to/from MP machine distribution of selected current day report data

4 CDR Presentation to TPTF - v1.11/22/08 Implementation Approach Create report specs in parallel to developing the system architecture Use incremental development and test approach Group current day reports based on EDS priorities; define report releases and align with the respective EDS releases The next pages provide a listing of the reports currently planned for delivery via the CDR project –The list of reports may evolve as reporting requirements and specifications are finalized through feedback from TPTF and ERCOT Business –Changes to the list will be maintained on the Nodal Data Services Master List (NDSML) document The NDSML references all interactions outside of user interfaces, including reports, extracts, downloads, web services Includes cross references to Protocols Updated weekly (every Friday) Should be reviewed for completeness and access methods

5 CDR Presentation to TPTF - v1.11/22/08 CDR 1A Release – Currently Identified Contents Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08EDS 4 - Release # NP CD Seven-Day Forecasts (ERCOT System, Weather Zone, and Load Zone Forecasts for next 7 days, by hour) 3.12 (a)9.2 NP CDShort-Term System Adequacy Report (2)9.2 EDS 4, Release reports to support Outage Scheduler Reporting

6 CDR Presentation to TPTF - v1.11/22/08 CDR 1B Release – Currently Identified Contents Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08EDS 4 - Release # NP CDDaily Electrical Bus Load Distribution Factors (e)9.3 NP CDAwarded Day Ahead Market Ancillary Service Offers (2) (e)9.3 NP CDDay Ahead Market Hourly LMPs (2) (c)9.3 NP CDDay Ahead MCPC (2) (a)9.3 NP CDAggregated Ancillary Service Offer Curve (2) (h)9.3 NP CDDay Ahead Market Settlement Point Prices (2) (b)9.3 NP CDDay Ahead Market Shadow Prices (2) (d)9.3 NP CDDay Ahead Market Total Energy Bought (2) (f)9.3 NP CDDay Ahead Market Total Energy Sold (2) (g)9.3 NP CD Distribution Loss & ERCOT Transmission Loss Factors for Settlement Intervals of the Operating Day (g)9.3 NP CD ERCOT System, Weather Zone, and Load Zone Forecasts (for next 7 days, by hour) (d) (i)9.3 NP CDAncillary Service Plan (1)9.3 NP CDAncillary Service Obligations & QSE Load Ratio Share (3)9.3 NP CD Weather to Forecast ERCOT System Conditions & Dynamic Ratings Processor (b)9.3 NP CDWGRPP Forecasts Aggregated for All WGRs 4.2.2(5)-(6)9.3 NP CDWGRPP Forecasts for Each WGR 4.2.2(4)9.3 NP CDActive and Binding Transmissions Constraints 5.3 (3) (b) (i)9.3 EDS 4, Release reports to support DAM & RUC functionality

7 CDR Presentation to TPTF - v1.11/22/08 CDR 2.0 Release – Currently Identified Contents – 1 of 3 Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08EDS 4 - Release # NP CDPermanent Removal of Electrical Bus within Hub Bus (2) 9.4 NP CDDeselected Contingencies (11) 9.4 NP CDTemporarily Removed Contingencies (6) 9.4 NP CD ERCOT System Demand from Real-Time Operations per Settlement Interval (3) (d) 9.4 NP CD Real-time Load Forecast Distribution Factors for MPs to calculate Electrical Bus Loads (3) (e) 9.4 NP CDNotification to QSEs of No Output Schedule or Energy Offer Curve NP CDReal-Time Prices Parameters (2); NP CDRMR Services Quantities (3) (c) 9.4 NP CDSASM MCPC ci: (2)(a) (3) 9.4 NP CDShift Schedules NP CDSystem-Wide Load Forecasts (3) (b) 9.4 NP CDTotal Ancillary Service Procured in SASM ci: (2) & (3) (3) 9.4 NP CDTotal ERCOT System Demand (3) (a) (i) 9.4 NP CDUpdated Electrical Bus Load Distribution Factors ci: 6.3.2(3)(e) (3) (a) (i) 9.4 NP CDValidated Output Schedules (3) 9.4 EDS 4, Release reports to support additional functionality

8 CDR Presentation to TPTF - v1.11/22/08 CDR 2.0 Release – Currently Identified Contents – 2 of 3 Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08 EDS 4 - Release # NP CDVoltage Schedules (4) (e) 9.4 NP CDThe sum of ERCOT generation from the State Estimator (4) (c) iv 9.4 NP CDFlow on the DC Ties from the State Estimator (4) (c) v 9.4 NP CD Binding Transmission Constraints with Causal Contingency or Overloaded Element Pairs (4) (f) 9.4 NP CDBreaker and Switch Status -- Network Security Analysis (4) (a) 9.4 NP CDDay-Ahead Market CRR Offer - Minimum Reservation Price (3) 9.4 NP CDCustomer Load Profile 9.4 NP CDDerated CRRs 4.5.1(8) 9.4 NP CDMarket MCPCs 4.5.2(2)(a) 9.4 Coms CDLoad Distribution Factors 9.4 NP CDCompetitive Constraints 3.19 (5) 9.4 NP CDDynamic rating deviation data 9.4 NP CDDynamic Ratings 9.4 NP CDVoltage Profiles 3.15 (1) 9.4 NP CD RRS deployment - RRS Deployment Instruction for non-controllable load resources 9.4 NP CDRRS Deployment Instruction for non-controllable load resources 9.4 NP6 – 62 - CDAncillary Services Capacity Monitor

9 CDR Presentation to TPTF - v1.11/22/08 CDR 2.0 Release – Currently Identified Contents – 3 of 3 Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08EDS 4 - Release # NP CDTotal ERCOT Generation Operating Reserve 9.4 NP CDTotal Regulation 9.4 NP CDUnit Availability 9.4 NP CDActive SCED Contingencies (1) 9.4 NP CDUndeployed Reg-Up and Reg-Down 9.4 NP CDBinding Constraints (5) 9.4 SYS CDForecasted Load 9.4 SYS CDFrequency 9.4 SYS CDMarket Totals 9.4 SYS CDReal-Time System Load 9.4 SYS CDShift Factors 9.4 SYS CDStartup and Shutdown Instructions 9.4 SYS CDAverage monthly Dynamic deviation 9.4 SYS CDAll real-time contingency violations 9.4

10 CDR Presentation to TPTF - v1.11/22/08 CDR 3.0 Release – Currently Identified Contents Index #Product name Traceability (Protocol/OG/NERC) PR AUG 08EDS 4 - Release # NP CDHourly Demand Forecast (3) 3.12 (a) 9.5 NP CD Topology Consistency Analyzer Incorrect Breaker and Switch Status NP CDOutput Schedule of Changes/Adjustments (6) 9.5 NP CDSCED Shadow Prices (2) 9.5 NP CDShadow Prices on Binding Transmission Constraints (4) (g) 9.5 NP CDState Estimator Transmission Flows and Voltages (4) (b) 9.5 NP CD State Estimator 15-minute Load Averages on Electrical Buses (4) (h) 9.5 NP CD Individual transmission Load on Electrical Buses from the State Estimator (4) (c) i 9.5 NP CD State Estimator Transformer Flows, Voltages and Tap Position (4) (d) 9.5 NP CD LMPs by Resource Node6.3.2(2) 9.5 NP CD Sum of the Load on each Electrical Bus in each Load Zone from the State Estimator (4)(c) (4) (c) ii 9.5 NP CD Total Load on Electrical Buses in the ERCOT System from the State Estimator (4) (c) iii 9.5 EDS 4, Release reports to support remaining EDS requirements, as well as to deliver State Estimator and SCED reports that are already in EDS with a temporary solution

11 CDR Presentation to TPTF - v1.11/22/08 ERCOT Enterprise Architecture’s Vision Common set of capabilities to enable query/retrieval, data aggregation of data from specified data sources, and perform any aggregations and calculations if needed Simple, stateless, extremely lightweight, horizontally scalable services Language-neutral business logic engine that enables business rules to be implemented in plain Java, SQL, PL/SQL and other scripting languages Outputs can be easily formatted into XML, HTML, CSV, etc. and Java objects / other formats Reports will contain data elements that are a part of the NODAL SoSA Domain model

12 CDR Presentation to TPTF - v1.11/22/08 Current Day Reporting High Level View Static HTML and Charts Report/Extracts (pdf, doc, xls, csv and xml) External Web Services Information Abstraction Business Layer TransformationsSchemas Business Logic and Aggregation Computational Logic Queries Reporting Engine Report Design and Implementation Report Form Layouts Report Publishing Report Storage and ILM EMS Staging Database MMS Staging Database OtherMIRODS Market Participants

13 CDR Presentation to TPTF - v1.11/22/08 Current Day Reporting Strategy Leverage ERCOT Enterprise Architecture for reporting Adopt 8 hour-SLA for replication streams to be resolved into ODS Connect to Source Staging databases for reports that rely on data that is not available in ODS yet Connect to ODS and MIR for archived reports that rely on data that is not available in the source system anymore Perform data aggregations, computations, and business logic that is required for report generation and is not performed by source systems as required and dictated by the nodal protocols and translated by the ERCOT business team Generate reports and extracts as defined by the report layout templates and schemas from the ERCOT Domain Model Store the generated report in ERCOT repository MIR Produce rich graphic content to be displayed via the MIS Portal Enable Web Services to deliver the same data to market participants

14 CDR Presentation to TPTF - v1.11/22/08 Current Day Reporting Architecture Diagram

15 CDR Presentation to TPTF - v1.11/22/08 Current Day Reporting Architecture Java Engine connects to the Source System(s) staging tables and the ERCOT EDW MIR based on configuration and latency requirements Java Engine extracts the data within the required time per report and performs data aggregation, business logic, and computations per the domain model Data from the Java Engine is then presented to the Reporting Engine (JReport) to be assembled into a report as defined by the business requirements for that report Data can also be translated into graphs and charts to be represented in the MIS Portal Data is also enabled to be delivered via Web Services interfaces Reports are then persisted in the ERCOT EDW MIR for archival and retrieval

16 CDR Presentation to TPTF - v1.11/22/08 Major CDR Team Accomplishments Consolidated list of CDR reports Prioritized CDR reports to match EDS release priorities / schedule Completed Project Charter and Budget Completed initial report specs; working on completing the remaining specifications Completed Technical Architecture document CDR Conceptual System Design (CSD) document available for TPTF review and approval Built the core project team and established interfaces Low Level Design and Development in progress

17 CDR Presentation to TPTF - v1.11/22/08 Q&A Answers to any Questions you may have