Information Technology Service Availability Metrics March 2008.

Slides:



Advertisements
Similar presentations
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
Advertisements

Information Technology Report Dave Pagliai Manager, IT Support Services March 2015 ERCOT Public.
Database development (MIS 533) MBS in Management Information Systems and Managerial Accounting Systems (2007 / 2008) Fergal Carton Business Information.
1 RMS Workshop Retail Systems Disaster Recovery ERCOT May 6 th, 2014.
Information Technology Report Dave Pagliai Manager, IT Support Services January 2015 ERCOT Public.
Information Technology Report Trey Felton Manager, IT Service Delivery January 2012 ERCOT Public.
RMS Update to TAC August 7, RMS Update to TAC ► At July 9 RMS Meeting:   RMS Voting Items:
Retail Market Subcommittee Update to TAC Kathy Scott April 24,
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
ERCOT Retail Market IT Update Aaron Smallwood Director, IT Operations Retail Market Subcommittee April 7 th, 2015.
1 TDTWG Update to RMS June 2, MarkeTrak API Performance Metrics Review ERCOT continues work with CenterPoint and Oncor to refine/revise the MT API.
RO Project Priority List Update EDW Projects Update RMS Meeting Adam Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 12, 2006.
Information Technology Report Dave Pagliai Manager, IT Support Services February 2015 ERCOT Public.
RMS Update to TAC January 3, Goals Update ► Complete and improve SCR745, Retail Market Outage Evaluation & Resolution, implementation and reporting.
RMS Update to TAC May 8, RMS Update to TAC ► At April 9 RMS Meeting:  Antitrust Training  RMS Voting Items: ► NPRR097Changes to Section 8 to Incorporate.
Retail Data Transport Upgrade ERCOT Recommendation ERCOT Public June 2015.
Data Extracts & Reporting Recent Issues ERCOT Information Technology Data Extracts Working Group 11/27/07.
1 TDTWG Update to RMS Tuesday January 6, Primary Activities 1.Reviewed ERCOT System Outages and Failures 2.Presented Service Availability and.
Enhancements to FasTrak PR Project Update Retail Market Subcommittee November 8, 2006 Adam Martinez Mgr, Market Operations DPO.
Market Impact Assessment TF Final Report to RMS June 11, 2008.
Information Technology Service Availability Metrics March 2008.
ERCOT IT Update Ken Shoquist VP, CIO Information Technology Board Meeting November 2003.
RMS Update to TAC January 8, Voting Items From RMS meeting on 12/10/2008  RMGRR069: Texas SET Retail Market Guide Clean-up – Section 7: Historical.
Annie Griffith January 2008 UK Link Technology Refresh.
1 TDTWG Update to RMS Wednesday February 14 th, 2007.
Objectives: Upgrade Siebel to a supported application Upgrade to Oracle 9i database Deliver all existing user functionality with no degradation in performance.
SCR786 - Alt Remove SIM dates from CERT Enhance CERT hardware and/or software Processing times at volume may not meet Performance Measures criteria Do.
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2 TDTWG April 2, 2008.
ERCOT Project Update ERCOT Outage Evaluation Phase 2 (SCR745) TDTWG May 7, 2008.
Information Technology Outage Report Dave Pagliai Manager, IT Support Services October 2015 ERCOT Public.
ERCOT Project Update Commercial Operations Subcommittee April 10, 2007 Adam Martinez Market Operations Division Projects Organization Please Note: These.
Retail Business Processes PR 50121_07 Project Update Retail Market Subcommittee September 13, 2006 Adam Martinez Mgr, Market Operations DPO.
Information Technology Service Availability Metrics Trey Felton IT Account Manager COPS/RMS September 2009.
PMO Update to PRS Troy Anderson ERCOT Program Management Office December 17, 2009.
Retail Transaction Processing Year End Review and Recent Issues RMS January 2007.
1 TDTWG Scope and Goals 2015 Wednesday January 8, 2014.
1 New RO Projects Hope Parrish June NEW RO Projects for 2008 Requested by ERCOT - Overview Objective Objective of the following information is to.
1 TDTWG Update to RMS Wednesday August 17, Primary Activities 1.Reviewed ERCOT System Outages and failures 2.Reviewed 2011 SLA 3.ERCOT presented.
Information Technology Report Trey Felton Manager, IT Service Delivery October 2011 ERCOT Public.
Retail Market Subcommittee (RMS) Update Kathy Scott April 9, 2013Commercial Operations Subcommittee 1.
June 2010 COPS/RMS Information Technology Report Trey Felton Manager, IT Administration.
February 10, 2010 RMS ERCOT 1/24/10 Production Issue Overview and Lessons Learned Karen Farley Manager, Retail Customer Choice.
September 21, Data Extract Projects Jackie Ashbaugh Commercial Operations Data Integrity & Administration September 21, 2006.
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
ERCOT Service Availability Metrics and Retail Systems Update April 2007.
Update to RMS December 18, Project(PR) 010_03 SCR756 Part B – High Level Timeline DRAFT:  Planning Phase: ~ (End of 2013) ◦ Business requirements.
Information Technology Service Availability Metrics Trey Felton IT Account Manager COPS/RMS January 2010.
1 TDTWG Update to RMS Tuesday March 3, Primary Activities 1.ERCOT System Outages and Failures 2.MarkeTrak Performance 3.Discussed 4 th QTR Performance.
9/13/2006 RMS Duplicate Retail Transactions. RMS9/13/2006 Background Duplicate Retail Transactions Types of duplicate transactions: –PaperFree duplicate.
1 TDTWG Report to RMS Recommended Solutions for SCR 745 ERCOT Unplanned System Outages and Failures Wednesday, August 10th.
RMS Update to TAC October 2, RMS Update to TAC TAC Confirmation Vote Request Kyle Patrick of Reliant Energy and Independent Power Marketer segment.
RMS Update to TAC November 1, RMS Activity Summary RMGRR057, Competitive Metering Working Group Name Change (VOTE) Update on RMS Working Group and.
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
April 2010 COPS/RMS Information Technology Service Availability Metrics Trey Felton Manager, IT Administration.
2006 Production Implementations Opportunities for MP testing prior to release COPS 4/28/2006.
1 Texas Data Transport & MarkeTrak Systems (TDTMS) Update to RMS March 1, 2016 Jim Lee (AEP) – Chair Monica Jones (NRG) – Vice Chair.
1 TDTWG Update to RMS Wednesday May 6, Primary Activities 1.Reviewed ERCOT System Outages and Failures 2.Reviewed Service Availability 3.Reviewed.
Retail SLA Proposed Changes RMS/TDTWG September 2008 Trey Felton IT Account Manager.
Information Technology Service Availability Metrics RMS August 2008 Trey Felton.
1 Customer Objections in Complete Status (CCO Clean-up Phase 3) Background Next Steps.
August 17, 2006 Data Extract Working Group EDW Project Updates 2006 / 2007 MO & RO PPL.
RO Projects Financial Overview Retail Market Subcommittee May 09, 2007 Adam Martinez Market Operations Division Projects Organization.
ERCOT Project Update ERCOT Outage Evaluation Phase 2 (SCR745) TDTWG November 5, 2008.
1 Market Operations Presentation Board of Director’s Meeting August 19, 2003.
RMS Update to TAC June 7, RMS Activity Summary RMGRR052 File Naming Convention for Customer Billing Contact Information URGENT (Vote) RMS Procedures:
Role of Account Management at ERCOT EIS Project Updates Jackie Ashbaugh Mgr., Commercial Operations Data Integrity & Administration DEWG October 19, 2006.
Retail Market IT Services SLA and Service Availability Metrics TAC August 2 nd, 2007.
Ken Shoquist VP, CIO Information Technology Board Meeting October 2003
Information Technology Service Availability Metrics
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2
Presentation transcript:

Information Technology Service Availability Metrics March 2008

Summary IT infrastructure and production change problems caused March IT performance to be below service level expectations Impacts to the market included delayed retail transaction processing, generation of duplicate transactions, delayed data extract & report posting, and outages outside of scheduled maintenance windows Efforts are complete or underway to remediate these problems and improve the IT infrastructure to avoid future problems in this area

Summary Retail Transaction Processing Outages & Delays –Causes: Failed Production Release –SCR-745 related production implementation caused delays and failures resulting in the decision to rollback to pre-implementation state Storage Hardware Failures –Multiple storage hardware failures caused unplanned outages, compounding transaction processing delays already slowed by the failed production release Human Error –During troubleshooting efforts, a computer operator started a session of a process that was already running, causing significant duplicate transactions to be generated and requiring the manual cleanup of transactions –Resolution: Failed Production Release –Due to slow performance and crashes, an outage outside of the standard maintenance windows was utilized to rollback to pre-implementation state –Technical analysis and discussions with TDTWG are ongoing to determine next steps regarding this phase of SCR-745 Storage Hardware Failures –Project to replace aged hardware has been in progress since late ’07 and is scheduled for implementation during the first weekend in May Human Error –Education and training –Operating procedure revisions to prevent future occurrences

Summary MarkeTrak slow system performance and failures –Causes: Application instability and limitations: Single vs. multi-threading processing abilities HTTP sessions management capabilities Storage hardware failures –When the SAN fails, the MarkeTrak application fails as well –Resolution: Application instability and limitations: Version upgrade that will address these issues has been in process since late ’07, two versions of the upgrade have failed ERCOT testing and have had to be returned to the vendor for fixes Most recent version upgrade is in ERCOT testing and if successful it will be promoted to production during the May release Storage hardware failures –Project to replace aged hardware has been in progress since late ’07 and is scheduled for implementation during the first weekend in May

Summary Wholesale Batch, Data Extracts & Reports Delays –Causes: Storage hardware failures –Failures delayed batch processing which in turn delayed reports and extracts Human errors –Data cleanup activities inadvertently caused incorrect data to be generated during the batch process, the remediation efforts required the backout and rerun of three operating days, much of which had to be performed manually –Permissions not granted properly during the March retail release, causing files to not be able to flow where they needed to for report generation –Resolution: Storage Hardware Failures –Project to replace aged hardware has been in progress since ’07 and is scheduled for implementation during the first weekend in May Human errors –Education and training

2008 Net Service Availability 3

March 2008 Net Service Availability 4

Retail Transaction Processing Availability Summary 5

TML Availability Summary 6

MarkeTrak Availability Summary 7