LO-5: Testing Lecturer: Ricardo Gonçalves

2 Testing Overview Conformance Testing –Definition –Methodologies –Application Architecture Interoperability Checking –Definition –Methodologies –Application Architecture Contents

3 What is Testing? Testing is the process used to help identify: –Correctness –Completeness –Security –Quality … of developed computer software. Testing is a process of technical investigation, performed on behalf of stakeholders, that is intended to reveal quality-related information about the product with respect to the context in which it is intended to operate.

4 Testing life cycle Software testing life cycle: Requirement Analysis Test Planning Test Development Test Execution Test Reporting Retesting the Defects

5 Types of Testing There are many types of tests, like: Performance; Robustness; Behaviour; Functions; Conformance; Interoperability;

Conformance Testing (CT)

7 ISO/IEC TR defined conformance and conformity as “fulfilment by a product, process or service of all relevant specified conformance requirements”. ISO/IEC DIS defined conformance testing as "test to evaluate the adherence or no adherence of a candidate implementation to a standard”.

8 Conformance Testing (CT) To apply the conformance testing to an implementation, the standards or specifications, must specify the requirements or criteria for conformance. In general this are done in a conformance clause or conformance statement. Also, to help in the conformance testing, some standards describe methodologies and platforms to implement the conformance testing.

9 CT - Methodologies ISO 9646: “Conformance Testing Methodology and Framework” ISO ’s parts a Conformance testing methodology and framework ETS (Methods for Testing and Specification (MTS), Protocol and profile conformance testing specifications, Standardization methodology

10 CT General concepts System Under Test (SUT) Implementation Under Test (IUT) Abstract Test Suits (ATS). SUT IUT Is verified and certified via adopts ATS Standard

11 CT Abstract Test Suits(ATS) ATS is defined by a set of Abstract Test Cases (ATC) describing in a conceptual format With the ATS defined for one AP, the Conformance Testing procedures can be executed on the IUT ATS needs to be instantiated creating the Executable Test Cases (ETC), which are the data and commands to be used to execute the test described in computer format.

12 CT Abstract Test Suits(ATS)

13 CT – “A Methodology” ISO 10303, Conformance testing methodology

14 CT – Application example EXPRESS Model XML DATA Is in conformance?? Retailer Manufacturer Model of exchanged messages Conformance testing of messages Request quotation received well format Tomas Smith Furniture Shop Blue Chair 20 ENTITY Request_for_quotation buyer: STRING seller: STRING product: STRING quantity: STRING Request_for_quotation Tomas Smith Furniture Shop Blue Chair 20

15 CT – Application Architecture

Interoperability Checking (IC)

17 Interoperability Checking IEEE define interoperability as "the ability of two or more systems or components to exchange information and to use the information that has been exchanged.” Interoperability testing is the act of determining if end-to-end functionality between (at least) two communicating systems is as required by those base systems’ standards. “ETSI”

18 IC Methodology – General concepts System Under Test (SUT) Implementation Under Test (IUT) Abstract Test Suits (ATS) Test Suite Structure and Test Purposes (TSS&TP) Interoperable Functions Statement (IFS) Implementation eXtra Information for Testing (IXIT) Executable Test Suite (ETS)

19 IC – “A Methodology” TS ; Interoperability test methods & approaches; Part 1: Generic approach to interoperability testing From: In Pursuit of Interoperability (ITJ2582) - Scott Moseley; Steve Randall; Anthony Wiles.

20 IC – Application Architecture From: In Pursuit of Interoperability (ITJ2582) - Scott Moseley; Steve Randall; Anthony Wiles.