Presentation is loading. Please wait.

Presentation is loading. Please wait.

Testing of XBRL files for the supervisory reporting Eurofiling Workshop in Rome Katrin Heinze 5 May2014.

Similar presentations


Presentation on theme: "Testing of XBRL files for the supervisory reporting Eurofiling Workshop in Rome Katrin Heinze 5 May2014."— Presentation transcript:

1 Testing of XBRL files for the supervisory reporting Eurofiling Workshop in Rome Katrin Heinze 5 May2014

2 Rubric © The objective of this presentation is to provide an overview on the testing strategy of the SUBA project to explain the test plan and sample test cases to inform about the next steps Page 2 Eurofiling Workshop in Rome, 5th of May 2014 Objectives

3 Rubric © Sample XBRL test cases Next steps SUBA * test strategy Overview Page 3 Eurofiling Workshop in Rome, 5th of May 2014 * SU pervisory BA nking Data System Agenda

4 Rubric © Sample XBRL test cases Next steps SUBA Test Strategy Overview Page 4 Agenda Eurofiling Workshop in Rome, 5th of May 2014

5 Rubric © Functional Tests Non-Functional Tests Regression Tests Based on User requirements Use cases Experience of users Technical requirements Source code (unit tests) … Categorised following Load tests (number of users) Performance tests (processing time) Volume test (quantity of data) Stress test Test of the (data) security Usability tests … Done after changes on Components o XBRL taxonomy o Validation rules Interfaces o EXDI o RIAD Infrastructure … Technical Test Execution Status SUBA Test Strategy Eurofiling Workshop in Rome, 5th of May 2014 Page 5

6 Rubric © HP ALM usage within the SUBA project Scope Planning of releases and test cycles Enable traceability between requirements, tests, defects and according code changes Increase visibility with dashboards on analysis and KPIs Achievements Definition of test cases linked to the defined requirements Execution of test cases based on defined test data Defect tracking and documentation of bug fixes Way forward Increase the level of automation on test execution Customise reports and analysis based on the project needs Preparation of test cases for the next release SUBA Test Strategy Eurofiling Workshop in Rome, 5th of May 2014 Page 6

7 Rubric © 1. level: Categories 2. level: Use cases 3. level: Test cases Conventions on numbering Structure in the Test Lab Test plan structure Eurofiling Workshop in Rome, 5th of May 2014 Page 7

8 Rubric © Tracking of the test progress in HP ALM Eurofiling Workshop in Rome, 5th of May 2014 Page 8

9 Rubric © Sample XBRL test cases Next steps SUBA Test Strategy Overview Page 9 Agenda Eurofiling Workshop in Rome, 5th of May 2014

10 Rubric © Positive functional test cases Creation of test data for each module of the COREP taxonomy which is a valid XBRL instance document. Valid according to XML specification XBRL 2.1 specification XBRL Dimension 1.0 specification XBRL Formula 1.0 specification EBA disabled validation rules EBA Filing Rules for COREP and FINREP By using different file sizes small medium large Sample XBRL test cases Eurofiling Workshop in Rome, 5th of May 2014 Page 10

11 Rubric © Negative functional test cases Tests that ensure that the application shows a proper behaviour when invalid files are received. Creation of test data where the system is expected to provide correct error messages. Possible test cases : A reporting entity sends a file which is not a well-formed XML document. has not the correct format, i.e. jpg, txt, xls etc. has not the expected encoding. includes neither facts nor contexts. misses a namespace in the xbrli root element includes letters where numbers are expected as fact value misses an explicit member in the scenario element Includes a fact with no value but also no nil attribute is provided Refers to a non-existing module Refers to two different modules. Sample XBRL test cases Eurofiling Workshop in Rome, 5th of May 2014 Page 11

12 Rubric © Sample XBRL test cases Next steps SUBA Test Strategy Overview Page 12 Agenda Eurofiling Workshop in Rome, 5th of May 2014

13 Rubric © Test scope Test period: 13 th to 15 th of May Test activities: Acquisition NCA sends data to EXDI via WebUI or standard adapter. EXDI system sends a delivery message. SUBA system sends an acknowledgement message to NCA with the XBRL validation result NCA receives the messages in the scheduled time periods. Eurofiling Workshop in Rome, 5th of May 2014 Page 13 Next steps Voluntary functional tests with NCAs

14 Rubric Load tests IT infrastructure for establishing a supervisory function at the ECB 14 Next steps First estimation about the load expected for the first remittance date Number of reported entities128 First remittance date NCAs to EBA/ECB Modules reportedNumber of files (per institute) Max. file size in MB Max. number of observations COREP consolidated Own Funds Large Exposures NSFR Total *) Estimations based on information of the Deutsche Bundesbank for one big German bank

15 Rubric Organisation and approach – Test case preparation Specification workshops Specification sign-off Implementation Development of software Definition of test cases (HP ALM) Tests execution Tests runs (HP ALM) Defects workflow (HP ALM) Bug fixing Control point MetricTarget (by priority) AverageHighMediumLow A% reviewed requirements100% B% requirements test coverage75%100% 50% C% tests run90%100% 75% % tests succeeded100% Defect resolution time (working days)335 Defects reopened ratio5% 10% Control point AControl point B Control point C Eurofiling Workshop in Rome, 5th of May 2014 Page 15 Next steps

16 Rubric © Key issues and challenges Load tests Defining scenarios for load tests on XBRL processing via automated test, simulating also peaks Preparation for next releases Defining test cases based on more precise user requirements EBA testing Participating in tests scheduled by EBA Functional tests Supporting the voluntary functional tests with the NCAs, organized by WG SIM Eurofiling Workshop in Rome, 5th of May 2014 Page 16 Next steps


Download ppt "Testing of XBRL files for the supervisory reporting Eurofiling Workshop in Rome Katrin Heinze 5 May2014."

Similar presentations


Ads by Google