1 Testing activities in project INRIA 1B Evaluation 23 October 2003 César VIHO

2 Why, how and who ? Interoperability is the final goal of any product developed in communicating systems area Bringing testing expertise into the existing design and development expertise to : Increase confidence on developed component Validate and improve the methodologies to be developed in both testing and design parts (i.e. “tests are used to test components and components are used to test the tests”)  Testing activities started in 2000 (one year after the creation Participants : C. Viho, R. Marie, L. Toutain, F. Dupont, D. Ros F. Roudaut, S. Barbin, F. Ngani, L. Tanguy, H. Leguen A. Minaburo, O. Medina, V. Phi

3 The context of testing activities Specifications/Standards Design and Development methodology B Implementation A vendor A Implementation B vendor B Conformance testing Interoperability testing

covers all steps of testing Generation of Abstract Test Suite (ATS) Compilation of ATS into Executable Test Suite (ETS) Execution of ETS against the Implementation Under Test (IUT) Test results Analysis Specification ATS ETS Verdict/log

5 Theoretical aspects and results (1) n Formal approach for :  Conformance and interoperability testing of communication networks and protocols,  Test selection and test coverage measurement n Models used :  IOLTS (Input-Output labeled transition systems)  Labeled Markov chains

6 Theoretical aspects and results (2) n Formal approach for interoperability testing : Definition and classification of interoperability testing architectures First formal definition of the notion of interoperability Formally proved answers to FAQs n Two solutions for distributed testing

7 IPv6 related testing n Test suites developed (both conformance and interoperability) : Core protocols (Neighbor Discovery, PMTU discovery, etc) Mobile IPv6 (Correspondent Node, Home Agent, Mobile Node) ID-13, ID-15, ID-18 and ID-19 Routing protocols (RIPng, OSPFv3) PPPv6 Transition Mechanisms (6to4, ISATAP, SIIT/NAT-PT) Header Compression mechanisms (ROHC)  Tight collaboration with the TAHI project in Japan

8 Organization of IPv6 interoperability testing events n In tight collaboration with the ETSI (European Telecommunication Standardization Institute) Plugtests TM Service n Test expertise provided for : The 4 IPv6 interoperability events organized by the ETSI (Sophia’2000, Cannes’2001 and 2002, Brussels’2003) Two Japanese TAHI IPv6 interoperability events (Yokohama’2002 and Chiba’2003)  project is now well-known and recognized as an expert group in IPv6 testing

9 The IPv6 certification programme “IPv6 Ready Logo” n A world-wide certification programme for IPv6 related products launched by the IPv6 Forum, ETSI and IRISA/Armor project n Based on interoperability testing results n IRISA/Armor is responsible of : The definition of technical requirements for the two phases of the programme The operational (applications examination and approval decision) for European applications  With our visibility today…

10 Next 4 years n Defining a formal framework and distributed approach for interoperability testing (continuing) Precise definition(s) of interoperability Test generation from formal specifications (Remote) testing platform and environment (using ISO/IS 9646, TTCN.v3 language) n Test generation for IPv6-related protocols and corresponding standardization and certification activities (continuing) n Towards Mobile Network Testing (gathering experience from MIPv6 testing) n Security testing combined with conformance and interoperability testing (test composition) n Test coverage (labeled Markov chains) T1T2T3 IUT1 IUT2IUT3