1 Market Data Transparency SCR 740 Business & Technical Training SCR 727 Phase II: Web Services ERCOT presents: Market Data Transparency.

Slides:



Advertisements
Similar presentations
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
Advertisements

Data Extracts Working Group (DEWG) Update Tuesday, September 25, 2006.
RBA Securitisation System Technical Delivery Forum Thursday, 29 January 2015 RBA Securitisation System.
N A managed approach to planning and controlling the implementation of complex application software. n A flexible tool kit, designed to support the Project.
MarkeTrak Update Retail Market Subcommittee December 6, 2006 Adam Martinez & Karen Farley.
RARF QnA Session April 17, Resource Registration Process and Schedule Final RARF forms sent during week of April 7 –New Resources should get blank.
Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS.
Role of Account Management at ERCOT Market Participant Identity Management Overview (MPIM)
Retail Market Subcommittee Update to TAC Kathy Scott April 24,
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
RDWG – MP Online Data Entry – Project Priority List / Update July 30, 2013 Troy Anderson.
Deliverable Readiness Review LexEVS 5.1 December 17, 2009.
PR Phase II SCR 727 SCR 740 Web Services Jackie Ashbaugh Commercial Operations Data Integrity & Administration August 18, 2006.
December 18, 2007 TPTF How ERCOT Websites and Applications Handle MIS Public, MIS Secure and MIS Certified Information Kate Horne.
RO Project Priority List Update EDW Projects Update RMS Meeting Adam Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 12, 2006.
SCR 740 Implementation of Web Services for ESIID level data Jackie Ashbaugh EAA Data Management.
MP Online Data Entry Project Update WMS / ROS August 2013 Troy Anderson.
Objectives: Develop a solution to either enhance or replace the FasTrak tool Scope/Why is this important?: Increase the transparency for issues that are.
1 “Data Enquiry Service” Update 5 December 2011 (by )
Lead from the front Texas Nodal 1 EDS 3 Release 5: SCED Phase 1 Kickoff Meeting August 1, 2007.
1 Market Data Transparency SCR 740 Business Training SCR 727 Phase II: Web Services ERCOT presents:
Enhancements to FasTrak PR Project Update Retail Market Subcommittee November 8, 2006 Adam Martinez Mgr, Market Operations DPO.
Lead from the front Texas Nodal 1 EDS 4 Release 9.1 DAM/RUC/SASM Market Call January 11, 2008.
 Advanced Metering Working Group (AMWG) Update to RMS 1 August 5, 2014.
ERCOT IT Update Ken Shoquist VP, CIO Information Technology Board Meeting November 2003.
Nodal COMS Update Commercial Operations Subcommittee January 13, 2009 Clay Katskee ERCOT - Market Operations Division Projects Organization.
Update to RMS January 14, MarkeTrak – Release 3 Release 3 was successfully migrated the weekend of December 13 th Stabilization period – Dec 13.
RMS Update to TAC January 8, Voting Items From RMS meeting on 12/10/2008  RMGRR069: Texas SET Retail Market Guide Clean-up – Section 7: Historical.
09/15/10 RMS RMS Market Reports – Recommendations Karen Farley Manager, Retail Customer Choice.
Objectives: Upgrade Siebel to a supported application Upgrade to Oracle 9i database Deliver all existing user functionality with no degradation in performance.
June 10, 2009 RMS PR90006, Commercial Systems Information Lifecycle Management (ILM) Hope Parrish, ERCOT.
1 CALPADS UAT End of Year (EOY) Checkpoint Meeting May 2, 2012.
Market Coordination Team Update Retail Market Subcommittee November 8, 2006 Susan Munson Retail Market Liaison.
10/13/10 RMS RMS Market Reports – Recommendations Karen Farley Manager, Retail Customer Choice.
1 C urrent Market Release TX SET V2.0 / Solution to Stacking.
Retail Business Processes PR 50121_07 Project Update Retail Market Subcommittee September 13, 2006 Adam Martinez Mgr, Market Operations DPO.
Information Technology Report Trey Felton Manager, IT Service Delivery September 2011 ERCOT Public.
PR50121_07 Retail Business Processes (RBP) Project Update Retail Market Subcommittee November 8, 2006 Adam D. Martinez Mgr, Market Operations DPO.
Lead from the front Texas Nodal 1 Texas Nodal Registration Kick-off Meeting Matt Mereness June 6 th, 2007.
Retail Transaction Processing Year End Review and Recent Issues RMS January 2007.
January 28, 2008 DEWG DEWG Discussion Questions ERCOT.
Objectives: Develop a solution to either enhance or replace the FasTrak tool Scope/Why is this important?: Increase the transparency for issues that are.
COPS – ERCOT PROJECTS UPDATE Retail & Services Platform Development Karen Farley March 22, 2005.
3 rd Party Registration & Account Management JDOA Update To RMS October 28, 2014.
MARS Advanced Metering – ERCOT Market Facing Changes Jackie Ashbaugh Manager Data Integrity and Administration 3/9/2009.
1 CALPADS UAT End of Year (EOY) Checkpoint Meeting May 16, 2012.
Enterprise Information Services Ray Chase Manager, EIS.
EDS 2 Early Delivery Systems Release 3 – Workshop August 16, 2007.
1 New RO Projects Hope Parrish June NEW RO Projects for 2008 Requested by ERCOT - Overview Objective Objective of the following information is to.
1 Transaction or Issue Clean Up. 2 Customer Protection and 814_08 Issue (Phase 2 – Potentially Late 08s) Background Completed Items Next Steps.
Changes to SSO Extract:  Based on DEWG discussions in 2005, ERCOT is recommending the following changes to the SSOE: In lieu of the current daily files.
September 21, Data Extract Projects Jackie Ashbaugh Commercial Operations Data Integrity & Administration September 21, 2006.
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
EIS Projects Update COPS Meeting Adam D. Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 28, 2006.
Lead from the front Texas Nodal 1 EDS 4 Outage Scheduler EDS Market Call April 25, 2008.
Objectives: Add remaining fields to the ESIID Look Up functions requested in PRR312. Scope/Why is this important?: Allow users to have improved access.
Automating the Dispute Submission System COPS Data Task Force October 20, 2004.
Lead from the front Texas Nodal 1 Early Delivery System Testing Environments & Planning – Involving Market Participants TPTF May.
Lead from the front Texas Nodal 1 EDS 3 Release 5 Phase 1 Testing Monday / Friday Market Updates September 26, 2007.
August 17, 2006 Data Extract Working Group EDW Project Updates 2006 / 2007 MO & RO PPL.
Alternative Proposal SCR786 Retail Market Test Environment September 2015.
MODPO Project Update Overview of December Implementations & EDW Changes Commercial Operations Subcommittee December 11, 2006.
Role of Account Management at ERCOT EIS Project Updates Jackie Ashbaugh Mgr., Commercial Operations Data Integrity & Administration DEWG October 19, 2006.
August 9, 2006 Retail Market Subcommittee Meeting MarkeTrak Update.
Session 6: Reports.
Commercial Operations Sub-Committee Update to RMS
MARS Taskforce RMS Update December 9, 2009.
Maintenance Ticketing Gateway (MTG) CEMR/MEDIACC Replacement
New Alma Customer Onboarding Preparation and Best Practices
Ohio Web Portal Ohio Edison, Illuminating Company, Toledo Edison
Presentation transcript:

1 Market Data Transparency SCR 740 Business & Technical Training SCR 727 Phase II: Web Services ERCOT presents: Market Data Transparency

2Market Data Transparency Training ground rules Be courteous to those around you. Please turn Cell Phones, Pagers, and Notebooks to vibrate/mute. If you have to take a call, please leave the room so as not to disturb those around you. Questions are welcome during the discussion. Please raise your hand to ensure everyone has the opportunity to participate. Have fun.

3Market Data Transparency Agenda Joint Business & Technical Meeting: Introductions & Expectations Agenda Overview & Course Goals SCR 740 Background Services Available General Information Future of Web Services

4Market Data Transparency Agenda – Breakout Sessions Business Breakout: Accessing Data Requests Using Data Requests Error Codes Technical Breakout: Using the GUI for Scheduled Data Requests Web Services Request Processing & Delivery

5Market Data Transparency Course goals Business users should walk away with a basic understanding of the specific services offered including: –Where and how to access these services –Inputs/Outputs of each service –Understanding of Point in Time Selectivity Technical users should be able to: –Understand SOAP & XML –Submit SOAP Requests and receive SOAP Responses –Handle fault and error codes –Basic understanding of EIS Operations

6Market Data Transparency SCR740 background SCR 740 was a System Change Request initiated by the Market in early The requirements as identified by ERCOT and the Market were: –Provide Market Participants capability to query ESIID level data (from the SCR727 ESIID Service History & Usage Extract) directly from ERCOT Systems –Capability for Market Participants to request baseline databases to recreate their entire 727 database –Provide audit capabilities

7Market Data Transparency Background cont. ERCOT met with the Market several times in 2005 to both identify the requirements and ensure Market understanding of the path ERCOT was taking to implement Web Services. In addition to these Market Trainings, ERCOT has continued to work with the Data Extract Working Group (DEWG) to keep the Market apprised of the progress and timeline of PR_ In November of 2005 ERCOT introduced the initial framework for Web Services and an overview of the Graphical User Interface(GUI) Prototypes in development.

8Market Data Transparency Background cont. In December of 2005 ERCOT met with the Market and held follow up conference calls to discuss the security and conversation strategies for the Web Services. Based on these discussions, ERCOT determined the following. –ERCOT chose to use the existing Digital Certificate process for security strategy –ERCOT opted to utilize a WSDL/SOAP Service over a REST Service

9Market Data Transparency SCR 740 & PR_50024 To implement SCR740, a project was created. This project is PR_ All information including presentations and documentation pertaining to SCR740/PR_50024 can be found on the ERCOT website project page at the following link: PR_50024 is currently in execution and scheduled to be implemented December 2, 2006.

10Market Data Transparency Accessing Web Services The Web Services/Data Requests for SCR 740 will be available via the Texas Market Link. Once logged into the TML, access the “Archive” tab in the top/middle of the page.

11Market Data Transparency Data requests High level overview of the fifteen Data Requests that are available via the GUI and Application Program Interface (API). The details of the requests will be covered in the business training session this afternoon.

12Market Data Transparency Data request index

13Market Data Transparency Transaction information Along with the GUI, you can also view the completed SOAP request and response messages under Transaction Information.

14Market Data Transparency Additional information Market Participants will only receive data results for ESIIDs that belong to them at the point in time of their request. Market Participants may upload a parameter file that includes ESIIDs/UIDESIIDs with no more than 1000 records. Data Requests are queried against ERCOTs Lodestar (Data Aggregation & Settlement system) ODS environment. The turnaround for these Data Requests will be less than 3 business days.

15Market Data Transparency Inoperability testing ERCOT is currently in the process of planning for a point-to-point market test. ERCOT is working to provide Market Participants the opportunity to perform Web Services connectivity testing by scheduling to test in a CERT environment starting Q This test will only test for a success/fail acknowledgement response on service request. This will ensure that Market Participants are able to connect to ERCOT point-to-point and ERCOT is able to read the automated Web Service request. This test will not provide payload data to the request. Once more details are available, ERCOT will communicate this information through the Data Extract Working Group and Market notices.

16Market Data Transparency Digital certificates All Market Participants will be required to have a Digital Certificate to access the Data Requests. You will be prompted to select your Digital Certificate when you enter TML. You can use the same Digital Certificate for all TML services (for example MarketTrak). To request a Digital Certificate you must contact your User Security Administrator (USA).

17Market Data Transparency Future of Web Services Data Extraction will remain a vital part of information services between ERCOT and the Market for the foreseeable future. ERCOT will continue to work with the Market to create and implement more dynamic data requests as needs are identified. Methods of generation, formats, and delivery capabilities will evolve over time. ERCOT continues to strive to create an efficient and effective environment for –Transparency in generation –Flexibility in format and delivery

18Market Data Transparency Future of Web Service cont. ERCOT will continue to utilize the DEWG to identify Market needs in the instance that extracts are not utilized for their original intent. –i.e. The Siebel Service Order Extract (SSOE) from PR_ As the usage of this extract varies out of the original intent, ERCOT hope to create dynamic ad-hoc queries for the information needed. ERCOT is also implementing a Web Service with the transition to a Nodal environment. ERCOT continues to monitor future projects and internal efforts to streamline extract changes with Web Services. –i.e. Load Counts and Volumes Reports which have low usage metrics but the need for certain pieces of data.

19Market Data Transparency Data formats and payload size Working to create a highly flexible formatting capability through the use of XML –XSL may be applied to XML at any time or place Internal to ERCOT (set delivery format) External to ERCOT (based on the customer’s need) Formats –Existing extracts will remain available in CSV –Future formats will be decided on, as needed, with a push to generate as much as possible in XML Sizing –REST delivery Small, individual transactions obtained and navigated, based on domain –Batch delivery Still reviewing what size limitations we have Current opinion is to handle 50GB Based on generation demands and persistency

20Market Data Transparency Where we are Current Status –Integration Testing (ITEST) in progress –Market Business & Technical Training scheduled for Friday, 11/10/2006 Extract Project Information Postings –Find draft versions of the following documents: User Guide, WSDL, Technical Specification, and Web Services 101 documentation at Market comments received from 1 MP; changes to be incorporated in next version –Market notice will be sent when ERCOT posts any updates to the draft documentation Market Testing Strategy –Planning for a point-to-point market test still a work in progress. ERCOT working through the details to ensure that the testing process is well-defined and environment hardware available/in place to support this type of testing –ERCOT is working to provide MPs opportunity to perform Web Services connectivity testing by scheduling to test in CERT environment starting Q This test will only test for a success/fail acknowledgement response on service request. This will ensure that MPs are able to connect to ERCOT point-to-point and ERCOT is able to read the automated Web Service request This test will not provide payload data to the request

21Market Data Transparency Project Timeline 10/9 ITEST Begins for 12/2/06 release PR /2 EIS Production Migration PR /10 PR Technical & Business Training Session by ERCOT 11/10 PR Post updated User Documentation 11/27 PR Post final User Documentation 12/10 Complete Production Stabilization Market Go Live PR Production Stabilization begins September OctoberNovember December JanuaryFebruary

22 Market Data Transparency Questions?