Download presentation
Presentation is loading. Please wait.
Published byKimberly Freeman Modified over 8 years ago
1
System Ready Forum 12 July 2016
2
Welcome Welcome to July’s SRF Housekeeping Objectives for the day
3
Agenda ItemDescriptionWhoTime 1. Tea & coffee All0930-1000 2. Welcome and introduction Objective for the day Stephen Winnie1000-1015 3. Update on: CIO Forum Operational Readiness call Test and Data SIG MEA Stephen Winnie Deepak Patel Stuart Heartfield 1015–1100 4. Key Issues and Blockers Test Data Training Service Stephen Winnie Deepak Patel Daniel Wyatt Beth Slade 1100- 1200 5.BreakAll1200-1215 6.Update on the planStephen Winnie1215- 1300 7.LunchAll1300- 1345 8.MP categorised Market Participants Q & A – please submit any issues to be included by cob Friday if possible MP1345-1500
4
Agenda continued 9. MOSL detailed updates Data loads DVS Data iteration 2 Data iteration 3 MEA Schedule Volunteer UAT Final upload schedule Shadow Market Operations Bi-lateral update from the workshop on the 22/06/2016 Performance testing Items for discussion All1500- 1545 10.Meeting Close Communication Update AOB/ Wrap up Tom Notman Stephen Winnie 1545- 1600
5
Update on: CIO Forum Operational Readiness call Test and Data SIG MEA
6
CIO Forum Terms of Reference reviewed Overview of Quality Assurance and Governance Review of test coverage Further Analysis of ‘excluded’ scenarios at next meeting Updated Settlements test approach and July Quality Gate Preview of Performance Test Plan Further Analysis at future sessions
7
Operational Readiness Call Updates on MP readiness Files successfully loaded v provided and Forecast Updates on Market readiness Aggregated files successfully loaded v provided and Forecast Question over MPS availability Settlement testing refocus Guidance documentation publication Usability question – PEEK/DEQUEUE
8
Updates From July Test and Data SIG Item SummaryActions/Update Date of SIG Wednesday 6 th July Data Updates on progress in Data Iteration 2, Plan for Iteration 3 Schedule for Final Data Upload MPS MP questions MPS MPS availability and upgrade Issues Data considerations still causing validation failures MP questions
9
Updates From July Test and Data SIG Item SummaryActions/Update Date of SIG Wednesday 6 th July Test Update Updates on progress – SIT Phase 2.0; UAT Phase 2.0 Settlements approach and Quality Gate UAT to MEA dependency MEA Publishing UAT progress of MEA scenarios Detailed Guidelines for MEA Test Planning & Execution Settlements in MEA Non Functional Testing Performance Test Overview Dates for Security and Penetration Testing
10
Test – Status Update – SIT Phase 2.0 @ 7 th July
11
Test – Status Update – UAT – LVI/HVI @ 7 th July
12
Test – Status Update – Defect Tracker @ 13 th July
13
MEA update - scope System A System C Middleware System B MEAT Coverage New CMOS New New i/f Significant Change Legacy New i/f
14
MEA – Updated advice on test schedule Updated advice on MEA test execution window Validate Environment set up before 10-day window Complete IDTT in advance if possible Front Load schedule with transactions Transfer Registration requires 6 elapsed days Maximise time for queries and defect resolution
15
MEA – Settlements With regard to the analysis and evidence required to validate the Settlement scenarios – the evidence should show that the output report has been downloaded into the receiving system, and the report should show the effect of prior transactions within this test environment. Specifically the report from the corrective settlement run (Scenario #12), should show the effect of the correcting transaction (Scenario #10 or #11). The MEA team will work with you to ensure that the Settlement runs are set up to cover transactions processed during the MEA scenarios. The MEA team will evaluate expected values from the Settlement runs, and will work with you to understand and resolve any discrepancies before completing the Settlement scenarios.
16
Q&A
17
Key Issues and Blockers
18
Test Balancing UAT / MPS defect turnaround against completion SIT Phase 2.0 and 2.1 Co-located test teams in Groningen From UK, Poland, Netherlands Brings developers and testers together in single physical location to speed up turn around and communication between tester and developer. Increased frequency of build and deployment into UAT weekly/twice weekly Completing Settlements UAT UAT to MEA transition
19
Data – Issues and Blockers
20
Data Blockers and Issues Item SummaryActions/Update Cut-over plan for final data upload MOSL creating cut-over plan to draw out dependencies, sequences, and owners of tasks in the lead up to Shadow Market Date of plan delivery to be confirmed through MOSL weekly update Cut-over planning – i.e. big bang or phased migration ahead of shadow market Final data upload schedule to be published on MOSL website Participants started to select slots in the lead up to Shadow Market to allow for business dependencies/processes to bed in By implication, a Phased approach to migration Outstanding CRs for CMOS Data Migration tool All changes now in impact assessment cycle; awaiting confirmation of delivery dates before being approved CMOS CR to change current logic that requires all Address lines to be completed for a change of address Collective agreement from market participants that this change should be available in Release 2.x or pre-Shadow Market release in order to prevent risk of changes to business processes within their own organisations. WRC017 and WRC022 – CGI to provide detail on option to bring forward into pre-Shadow Release. Opportunity for a 4th data upload, prior to final (pre-shadow market) upload Data iteration 3 will complete on 19 th August 2016 Mitigation for a 4 th data upload is that the ability to validate data will still be available (i.e. equivalent of DVS)
21
Data Blockers and Issues Item SummaryUpdate New ICP change to allow spaces in Meter Manufacturer Market participants concerned that the true meter manufacturer/serial number unique combinations being ‘masked’ by having to either remove or substitute spaces in meter manufacturer for initial data upload Market participants considering a change being raised through ICP MPS full/large data loads Storage available to accommodate full volume loads CMOS Data load tool requires ‘performance’ fixes to be deployed, currently planned for 18 th July 2016 Final Data Upload Many MPs selecting final week and weekend
22
Training Market and Interface Training A total of two Market training sessions and eight Interface training sessions (four Wholesale and four Retail) held in June 2016. 75 delegates from 30 different Market Participants attended Interface training at CGI offices in Reading. Overall satisfaction score of 95% received from Interface training sessions. Training Delivery (Phase 2.0) Training courses defined and schedule updated for Phase 2.0 training for Market Participants – currently under review by MOSL. Once approved this will be published on the MOSL website for Market Participants to register for each event. Training Documentation The Wholesaler and Retailer User Manuals will be updated in line with Phase 2.0 delivery – these will be released at the same time as deployment into MPS (currently 08 August 2016).
23
Key Issues and Blockers- Service No current issues; phase 2 preparation is underway: Organisation data is created in readiness for 1 st August; the last batch is finalising testing. Requestor details are being loaded Organisations that provided new requestors will have those present Organisations that didn’t will have their existing requestors transferred. Knowledge Transfer planning is in progress. [Live update on numbers]
24
Q&A
25
Break Reconvene in 15 minutes
26
Update on the plan Settlement System Integration Testing & FAT 1)Settlement SIT proven 246/246 priority scenarios triggered by CMOS 2)Settlement FAT proven over 400 of 518 scenarios with target to exit by end of July Market Participant Sandpit 1)18 Wholesalers & 15 Retailers connected and active 2)1.5m transactions performed on this environment by participants to date 3)206 of 233 Participant issues closed with 27 in progress HVI / LVI User Acceptance Testing 1)Co-located teams in Groningen Strategy is working 2)HVI is 52% complete 3)LVI is 58% complete 4)Actual passes is running behind Forecast (887 passed of 1042 – delta of 155 passes) a.Defect resolution rich Releases scheduled for 12 th and 15 th July to unblock defects and to support acceleration of passes 5)Both on target to complete by end July
27
Update on the plan Settlement User Acceptance Testing Assurance Panels (Senior Financial & CIO Technical) kick-offs held and strategy gone through Latest test statistics published and discussed Projections and scope discussed Next sessions will deep dive into settlements scope and coverage Quality gate for end July targeting 77% coverage and confidence in settlements on expected market scenarios Additional resources drafted in from Deloitte and MOSL Market Services to support delivery Beyond July there will be continuous improvement and testing in place to move into greater assurance into the edge cases and uncommon scenarios
28
Update on the plan Market Participant Testing Additional environment being made available to participants as we have heard your requests and challenges MPS2 being created to make data invisible to all – you will only see your own data This enables DPA issue to be worked around and for real data to be uploaded All data will then be revealed at Shadow Current MPS1 will continue un-masked MPs will be able to use this environment to test interoperability with partners (presumably using dummy or anonymous data)
29
Q&A
30
Lunch Reconvene in 45 minutes
31
MP categorised Market Participants Q & A Absence of actions from last meeting – will issue today. Release content and visibility of 2.0, 2.3 2.3 – firm up release when clear 2.0 at end of July SLAs
32
Release 2.0 – MPS 18 th July The following table lists the Release 2.0 items added next week. 32 Release 2.0 Functional Item Comments Tenant relationships Market portal logins
33
Release 2.0 – Current Status The table below provides breakdown of the Release 2.0 functionality that will be made available in the planned MPS release of 15 th July 2016 Confidence level as a % of SIT completion, and known issues. CMOS Component field values cover Portal and B2B (HVI message Layer). 33 Release 2.0 FunctionalityCMOS ComponentSupplementary InformationConfidence %Known Issues Calculated Discharge Volume B2B Adding discharge volumes to discharge points via transactions 100 Calculated Discharge Volume Portal Adding discharge volumes to discharge points via the CMOS Portal 100 Tariffs FullPortal Create and Update Tariff and Tariff Data, Merge Charge Element Fields, Authorise Tariffs, Create and Update Timetables, Merge Timetables, Import Tariffs, Retire Tariffs 90 Remaining issues from latest regression test. Examples; Access to Tariff data – rules on what organisations can see what Tariff data Deleted timetables remain visible in the Portal / forced refresh to display latest data Screen buttons remain active when not expected (Add Tariff button) TCORRsB2B 99 TCORR125.W: this is in the release but is not functioning as it should be a Retailer transaction, though it is defined in CSD0301 as a Wholesaler transaction TCORR115. This transaction is part of ICP/WRC014 which has not been approved for implementation to CGI TCORRsPortal All TCORRs have passed UAT in this release, apart from the following; TCORR177.W, TCORR166.W, TCORR165.W, TCORR143.W, TCORR168.W, TCORR125.R, TCORR173.W, TCORR171.W, TCORR171.R, TCORR172.W, TCORR172.R, TCORR105.W, TCORR105.R 92 TCORR125.W: this is in the release but is not functioning as this should be a Retailer transaction but is defined in CSD0301 as a Wholesaler transaction TCORR115. This transaction is part of ICP/WRC014 which has not been approved for implementation to CGI Meter NetworksPortal 100 Non Market MetersPortal 89 Agreement ManagementPortal/B2B Allows Market Participants and the Market Operator to register wholesale contracts and to opt in for gap site allocation and for interim supplier allocation 95 Market Portal Logon Portal33 Tennant RelationsPortal100
34
Release 2.0 – Known Exclusions The following table lists the Release 2.0 items not available in this release. 34 Release 2.0 Functional Item Comments Estimated Meter Reading Functionality not available in release. Development is complete one issue remains blocking the completion of SIT Report Integration (no reports available in this release) Functionality not included in release: Reports developed environment set-up ongoing before release to MPS (FTP delivery)
35
Q&A
36
MOSL detailed updates Data loads DVS Data iteration 2 Data iteration 3 Volunteer UAT Final upload schedule Shadow Market Operations Bi-lateral update from the workshop on the 22/06/2016 Performance testing Some MPs do not have an alternative System to CMOS to run transactions in Shadow. Should CMOS not be available these MPs will not be able to transact. A number of MPs are reliant on a few middleware and billing providers this could result in groups of MPs not being ready if a single supplier gets behind. Misalignment of operational data sets created by customer premises activity during the upload period (Meter exchanges) Certain transactions will need to be recorded manually until appropriate software release
37
Update - DVS DVS to be withdrawn 22 July 2016 to build for MEA. DVS capability will continue to be provided in DATA environment MPs should provide any DVS data extracts as at present and use same nomenclature point
38
Data Iteration 2: Closing Position 20 of the 20 participants provided data to upload 4 participants did not submit any data 6 participants data files being loaded in Week 4 Summary of provision of data files by market participants Participants not providing data are in active dialogue with Portfolio Managers to appraise them of their individual situations Working directly with MPs to resolve issues where we can Back loading the data iteration presenting risks to data load and your time to react
39
Data Iteration 2 – Load Status So Far Water only companies would not provide all data files – percentage load takes this into account Higher volumes of data, generally for Data Iteration 2 New/amended validation rules in play for Data Iteration 2 Represents data loaded to the Database with consent from market participants Aggregated View Forecast Total Received Total Processed (Actual) % Actual against forecast Supply Point2,637,3772,204,2391,753,55266% Service Component478,0112,981,1972,425,462507% Meter312,8151,154,352869,983278% Meter to Supply Point -533,08945,346 N/A Meter Reading2,798,84811,465,2646,062,865217% Meter Network65416,599 5,370821% Discharge Points13,13011,0435864% Metered Discharge5,62811,04358610% Calculated Discharge 1,2651,08610% Participant View Service Type Market Participant ID Data Iteration 1Data Iteration 2 WOC176.94%99.39% WASC2 3 98.10% WOC597.84%99.80% WOC6 7 0.00% WASC8 984.94%36.93% WASC100.00% WOC1191.08%100.00% WASC12 WASC1325.51%93.81% WASC14 99.99% WOC1517.94%100.00% WASC1666.42%99.76% WASC17 WASC18 WOC190.05%99.87% WASC2046.75%98.86% WASC2117.41%99.60% WASC / NAV22 WASC23 94.10% WASC2416.77%99.95% WASC2528.78%94.68% WASC26
40
Data Iteration 2 – Load Timings Table shows average record processing (extract, validate, load) per hour, in isolation of any other data file being processed Conclusions drawn so far: Very large swings in data processing & load time, impacted principally by contention on hardware Average load time is in the range of 130,000 to 150,000 records per hour ‘Phased’ approach is recommended on the basis of these average load times
41
Data Iteration 2 – Read Profiles Reads taken from latest submissions to derive a projection of reads expected each day Eleven MP datasets used so far Excluded weekends which allows an adjusted average value Min of COUNT(*)Max of COUNT(*)2Average of COUNT(*)3Part. code 1883454.701 146681294.823 13396487.029 1482133.6811 233601304.0013 11415393.2314 1531187.8315 212326918.6216 441191576.9120 187162764.8921 11138382.8224 9898
42
Update - Data Iteration 3 Schedule Data Iteration III Week 1Week 2Week 3Week 4 Week 1 - W/C 25/07Week 2 - W/C 01/08Week 3 - W/C 08/08Week 4 - W/C 15/08 N/A
43
Volunteer UAT Volunteer market participants’ support for MOSL UAT: Preparations are in place for 4 volunteers from Anglian Water and Castle visiting MOSL offices 14 th July 2016 to participate in MOSL LVI UAT. Pro- formas are complete, data loads are being progressed to set up the UAT environment for the two companies participating in testing. LVI Test scenarios have been shared with the volunteers. UAT environment set up requirements have also been circulated to the volunteers who have offered support for HVI testing to submit updated pro- formas together with the test data for UAT. As part of UAT we will also run settlement and share the results with the participants. MOSL HVI test scenarios have also been shared.
44
Update – MEA Schedule
45
Current Composite Plan 18/725/701/0808/0815/0822/0829/0805/0912/0919/0926/0903/1010/1017/1024/10 DVS Environment 22/7 – DVS withdrawn 29/7 MEA build complete MEA Execution Remedial MEA 23/09 – MEA Execution Complete MEA Build DATA Environment Data Iteration 3 Submit Tariffs for MEA 19/08 – Data Iteration 3 complete Refresh Support post DVS Final Data Upload Shadow Market
46
Update - Final Upload Schedule FINAL LOAD TO PRD Market Participant ID Week 1Week 2Week 3Week 4Week 5 Week 1 - W/C 29/08Week 2 - W/C 05/09Week 3 - W/C 12/09Week 4 - W/C 19/09Week 4 - W/C 26/09 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26
47
Data – Final Upload Schedule Week 1 Market Participant ID Week 1 - W/C 29/08 MondayTuesdayWednesdayThursdayFridaySaturdaySunday 29/08/201630/08/201631/08/201601/09/201602/09/201603/09/201604/09/2016 1 2 3 4 5 6 7 8 9 10 11 12N/A 13 14 15 16 17 18 19 20 21 22 23 24 25
48
Data – Final Upload Schedule Week 2 Market Participant ID Week 2 - W/C 05/09 MondayTuesdayWednesdayThursdayFridaySaturdaySunday 05/09/201606/09/201607/09/201608/09/201609/09/201610/09/201611/09/2016 1 2 3 4 5 6 7 8 9 10 11 12N/A 13 14 15 16 17 18 19 20 21 22 23 24 25
49
Data – Final Upload Schedule Week 3 Market Participant ID Week 3 - W/C 12/09 MondayTuesdayWednesdayThursdayFridaySaturdaySunday 12/09/201613/09/201614/09/201615/09/201616/09/201617/09/201618/09/2016 1 2 3 4 5 6 7 8 9 10 11 12N/A 13 14 15 16 17 18 19 20 21 22 23 24 25
50
Data – Final Upload Schedule Week 4 Market Participant ID Week 4 - W/C 19/09 MondayTuesdayWednesdayThursdayFridaySaturdaySunday 19/09/201620/09/201621/09/201622/09/201623/09/201624/09/201625/09/2016 1 2 3 4 5 6 7 8 9 10 11 12N/A 13 14 15 16 17 18 19 20 21 22 23 24 25
51
Data – Final Upload Schedule Week 5 Market Participant ID Week 5 - W/C 26/09 MondayTuesdayWednesdayThursdayFridaySaturdaySunday 26/09/201627/09/201628/09/201629/09/201630/09/201601/10/201602/10/2016 1 2 3 4 5 6 7 8 9 10 11 12N/A 13 14 15 16 17 18 19 20 21 22 23 24 25
52
Update – Shadow Market Operations Data load – Final Phased approach Update Market data by Transaction Market Readiness Detailed Data Iteration review
53
Update – Bi-laterals The work to establish the common industry standard is now complete and the following have published 2 documents: Operational Subsidiary Document OSD 0601 – including the Operational Transaction Catalogue (OTC) Operational Subsidiary Document – OSD 0602: Bilateral Message Transport Standards. These are the agreed outputs from the Industry, and complete the work undertaken by MOSL following the consultation from 31 May to 15 June 2016
54
Non-Functional – Performance Test ApplicationTransaction Number of users performing the transaction per hour Number of transaction per hour B2BUpdates on data (i.e. Core Address data)101100 B2B Meter Readings 206484 GUIView meter readings35550 GUIUpdates on data (i.e. Core Customer Data)30110 GUI Register SPID (only the T101 transaction to measure Gap Allocation) 56 ReportsReports (Create and retrieve)2022
55
Non-Functional – Security and Penetration Internal Test Commence 8 th Aug 5 days run, 5 days assess and report Complete 22 nd Aug External Test Commence 22 nd Aug 5 days run, 5 days assess and report Complete 5 th Sept
56
Items for discussion Some MPs do not have an alternative System to CMOS to run transactions in Shadow. Should CMOS not be available these MPs will not be able to transact. A number of MPs are reliant on a few middleware and billing providers this could result in groups of MPs not being ready if a single supplier gets behind. Misalignment of operational data sets created by customer premises activity during the upload period (Meter exchanges) Certain transactions will need to be recorded manually until appropriate software release
57
Q&A
58
Communications update Ofwat proposed national awareness campaign Open Water Communications Forum (28 June 2016) Changes to the Open Water website Expect to see an update from Ofwat later this summer Changes to the MOSL website ICP notes and Codes have been moved from the Open Water website to MOSL Wholesale and Retail industry events Self-assessments due 31 July Clarification of timing of WRC implementation – nothing changes until they have been signed off by Ofwat
59
Thank you… Safe journey home!
Similar presentations
© 2025 SlidePlayer.com Inc.
All rights reserved.