Data Extracts Working Group (DEWG) Update Tuesday, September 25, 2006.

Slides:



Advertisements
Similar presentations
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
Advertisements

Zonal ADR Resettlement & Data Retention ERCOT CSWG 04/20/2015.
Profiling Working Group 1 PWG Update Report By Brad Boles of Cirro Energy ERCOT PWG Vice-Chair for COPS Meeting November 6, 2007.
Nodal EDW Project Reporting Requirements & Conceptual Design Update EDW Project Team July 23, 2007.
ERCOT Billing, Settlement Disputes & Data Extracts
1 Emerging Issues. 2 Enterprise Data Warehouse (EDW)
PR Phase II SCR 727 SCR 740 Web Services Jackie Ashbaugh Commercial Operations Data Integrity & Administration August 18, 2006.
RO Project Priority List Update EDW Projects Update RMS Meeting Adam Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 12, 2006.
SCR 740 Implementation of Web Services for ESIID level data Jackie Ashbaugh EAA Data Management.
ERCOT Lodestar Extracts Timing Recommendation ERCOT May 24, 2005.
RMS Update to TAC January 3, Goals Update ► Complete and improve SCR745, Retail Market Outage Evaluation & Resolution, implementation and reporting.
Objectives: Develop a solution to either enhance or replace the FasTrak tool Scope/Why is this important?: Increase the transparency for issues that are.
August 7, Market Participant Survey Action Plan Dale Goodman Director, Market Services.
1 Commercial Operations Sub-Committee Update to TAC October 5, 2007.
MARS Taskforce COPS Update May 12, Execution MilestonesBaseline DateStatus Technical Architecture Complete 05/15/2009On Schedule Development Complete07/24/2009On.
Retail Market Subcommittee Update to COPS Kathy Scott July 16,
Update to RMS January 14, MarkeTrak – Release 3 Release 3 was successfully migrated the weekend of December 13 th Stabilization period – Dec 13.
09/15/10 RMS RMS Market Reports – Recommendations Karen Farley Manager, Retail Customer Choice.
Lead from the front Texas Nodal 1 Registration Market Call June Data Collection Window Aug 14, 2009.
March 11, 2008 Texas Nodal Market Redesign Program Commercial Operations Subcommittee.
June 10, 2009 RMS PR90006, Commercial Systems Information Lifecycle Management (ILM) Hope Parrish, ERCOT.
Overview of MID, MIR, & Extracts for DEWG 9/24/07 Steve Cox.
10/13/10 RMS RMS Market Reports – Recommendations Karen Farley Manager, Retail Customer Choice.
Commercial Operations Sub-Committee Update to TAC December 4, 2008.
1 ESI ID SERVICE HISTORY AND USAGE DATA EXTRACT SYSTEM CHANGE REQUEST (SCR 727) February 24, 2003.
MO Projects Update Adam D. Martinez Mgr, Market Ops Divisional Projects Organization ERCOT COPS Meeting May 23, 2006.
COPS – ERCOT PROJECTS UPDATE WHOLESALE MARKET DEVELOPMENT Paula Feuerbacher February 22, 2005.
Objectives: Develop a solution to either enhance or replace the FasTrak tool Scope/Why is this important?: Increase the transparency for issues that are.
MARS Advanced Metering – ERCOT Market Facing Changes Jackie Ashbaugh Manager Data Integrity and Administration 3/9/2009.
EDS 2 Early Delivery Systems Release 3 – Workshop August 16, 2007.
MARS Taskforce RMS Update November 10, Conference Call concerning Settlement Estimates TDSPs held a conference call on October 28, 2010, where we:
Commercial Operations Subcommittee Update to TAC November 5, 2009.
1 Market Data Transparency SCR 740 Business & Technical Training SCR 727 Phase II: Web Services ERCOT presents: Market Data Transparency.
COMMUNICATIONS AND SETTLEMENTS WORKING GROUP (CSWG) October 2015 Update to COPS.
Distributed Renewable Generation Profile Implementation Plan.
Lead from the front Texas Nodal 1 EDW Update to TPTF November 27, 2007 Janet Ply, PhD EIS Nodal EDW Project Manager.
Commercial Operations Sub-Committee Update to TAC April 4, 2008.
DEWG Meeting Summary Report to COPS 08/14/2007 Jim Galvin- Luminant Energy.
Changes to SSO Extract:  Based on DEWG discussions in 2005, ERCOT is recommending the following changes to the SSOE: In lieu of the current daily files.
September 21, Data Extract Projects Jackie Ashbaugh Commercial Operations Data Integrity & Administration September 21, 2006.
Demand Response Task Force. 2 2 Outline  Overview of ERCOT’s role in the CCET Pilot  Overview of Stakeholder Process – What’s been done to date?  Questions.
DEWG and SDAWG Meeting Summary Report to COPS 2/10/2009.
EIS Overview and Project Updates for DEWG Jackie Ashbaugh ERCOT April 13, 2006.
ERCOT Portal Replacement Phase 2 Project Update to RMS Presented by Dave Odle Thursday, October 16 th, 2003.
Lead from the front Texas Nodal 1 Registration Data Update Aug 25, 2008.
CCWG April 28 th Meeting CCWG Update to COPS May 12,
DEWG Meeting Summary Report to COPS 09/10/2007 Jim Galvin- Luminant Energy.
RMS Update to TAC November 1, RMS Activity Summary RMGRR057, Competitive Metering Working Group Name Change (VOTE) Update on RMS Working Group and.
EIS Projects Update COPS Meeting Adam D. Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 28, 2006.
1 Commercial Operations Sub-Committee Update to RMS November 10, 2005.
Oil and Gas Profile Implementation Plan. 2 BUSOGFLT Background ERCOT received Oil and Gas Profile Segment request ERCOT completed.
ERCOT Project Process Karen Farley COPS 3/22/05. Project Process  Overview of Project Requests  Process for Market Requests  Process for Internal ERCOT.
PR30026 Resource ID (RID) Extract and Recorder Extract Data Extracts Working Group May 18, 2006 Laura Zotter ERCOT Market Operations D P O.
9/29/2009 CCWG Website and Communications Follow-up Survey Amy Apodaca, Web Content Coordinator Art Deller, WCS Supervisor.
PWG Demand Response Follow Up Jackie Ashbaugh October 23, 2007.
August 17, 2006 Data Extract Working Group EDW Project Updates 2006 / 2007 MO & RO PPL.
Lead from the front Texas Nodal 1 Texas Nodal Market Implementation Program MIS Web Portal Business Requirements Review Current.
MODPO Project Update Overview of December Implementations & EDW Changes Commercial Operations Subcommittee December 11, 2006.
Lead from the front Texas Nodal 1 Texas Nodal EDS4 - Approach 11/28/2007.
Commercial Operations Subcommittee (COPS) 4/15/2015 Update to RMS 5/5/2015.
1 Commercial Operations Working Group Update to TAC April 7, 2005.
DEWG/SDAWG Meeting Summary Report to COPS 11/11/2008.
Role of Account Management at ERCOT EIS Project Updates Jackie Ashbaugh Mgr., Commercial Operations Data Integrity & Administration DEWG October 19, 2006.
Commercial Operations Sub-Committee Update to RMS
NMMS Nodal Network Mgmt and Monitoring System Update
Commercial Operations Subcommittee (COPS) Update to RMS 11/1/2016
Troy Anderson Program Management Office August 10, 2005
RMS Enhance ESI-id Look-up Function
DEWG Jackie Ashbaugh ERCOT
CCWG September 29th Meeting
Presentation transcript:

Data Extracts Working Group (DEWG) Update Tuesday, September 25, 2006

Meeting Schedule Last Meeting –September 21, 2006 ERCOT Austin 168 Next Meeting –October 19, 2006 ERCOT Austin 168

DEWG Update Screen Scraping Issues –Concern that there is no other way to get some data without continual website refreshing –Potential data elements missing in certain extracts that is available on website –ERCOT Action: can you determine what is being “hit” the most? ERCOT identified top 3 most hit sites –MP Action: please provide data elements that you think are only available on the website MPs provided many elements they currently hit, ERCOT shared ways to get some of the data, most items are unavailable via extract or API at the frequency required by the market

DEWG Update Screen Scraping Issues –MPs concerned that ERCOT “policies” conflict with current necessity to screen scrape or use continual website refreshing techniques –New ERCOT Action Item:* (possible vote) ERCOT to advise DEWG whether there is a Best Practices associated with “screen scraping” of ERCOT webpages, i.e. this is allowed under specific circumstances. If so, DEWG requests that ERCOT define when MPs can use screen scraping; otherwise advise DEWG how ERCOT can provide information available on ERCOT webpages that is not available in another format – at the same time or at a greater frequency in some instances. –Nodal concerns may need to be addressed

DEWG Update Data Extract Projects –Targeted timeline review –PR EPS Meter Data Extract aka Resource ID Extract –PR 40042_06 Lodestar Batch Extracts –PR EMMS Extracts –PR ESIID Lookup/TDSP ESIID Extract (PRR312) –PR SCR 727 Phase II (ERCOT's move of extract to ODS) –PR SCR 727 Phase II aka SCR740 Web Services –PR EDW Lodestar Transition –PR EDW Siebel Transition –COPS market testing action item

DEWG Update PR Phase II SCR 727 aka SCR 740 Web Services –Progress update –Market Training (November 9 th or 10 th ) –Discuss market questions received by ERCOT – see FAQ document –Review User Guide

DEWG Update MP Testing Concerns –Upcoming Projects MPs will have the opportunity to request ERCOT's verified stabilization files to be FTP’d or mailed –Lodestar Batch Extracts project (PR_40042_06) migrates the Generation, Load, Settlements & Billing, and Shadow Pricing extracts from the Data Archive to the ODS (Operational Data Store). This project is currently in production stabilization and ERCOT is now accepting requests from market participants to receive their verified stabilization files For new extracts Market Test files will continue to be posted to the ERCOT website –Web Services API testing ERCOT is investigating a potential test path for MPs (limited exchange of data) –.NET Environment Concern Raised MP raised a concern that ERCOT should be utilizing.NET environments in testing as part of their testing Best Practices Significant number of MPs use.NET for API related activities DEWG action?

DEWG Update Extract and Report Matrix –The DEWG Extract and Report Matrix is an excellent way to find information, definitions, locations, etc. of a lot of data utilized by MPs: Go to Click Committees and Groups Under COPS Click DEWG Scroll to Key Documents Click DEWG_Extract_and_Report_Matrix

Questions ???