1. 1 ETSI Plugtests  The interoperability service @METIS Kick-off Meeting The acid test: Testing Interoperability 31 March - Patrick GUILLEMIN ETSI Plugtests  Technical Manager

2. 2 The ETSI Resources in testing & interoperability are unique…  TC MTS (Methods for Testing and Specification)  Development of methodologies, techniques and languages  http://portal.etsi.org http://portal.etsi.org  ETSI PTCC (Protocol and Testing Competence Centre)  Supports ETSI TBs on the application of formal techniques in standards on a daily basis  Development of test specifications (conformance and interop)  http://www.etsi.org/ptcc http://www.etsi.org/ptcc  ETSI Plugtests Service  Validation of standards and prototypes through interoperability events http://www.etsi.org/plugtestshttp://www.etsi.org/plugtests …and complementary!

3. 3 Plugtests TM events look like this: Oh I discovered a BUG !!!!

4. 4 Plugtests Interoperability Test Events?  Classical Conformance and Interoperability tests: IPv6, SIGTRAN, SIP, VoIP, ENUM…DSL, SMS-MMS  Proof of concept and performance evaluation (early phase): RFID, IRAP, Powerline, UWB, NGN  Services interworking: OSA/Parlay API and Web Services, ebXML, XAdES and PKI  Benchmark, Contest, Deployment and Portability: Speech Quality, GRID with N-Queens contest, J2ME…

5. 5 INTEROPERABILTY and CONFORMANCE TESTING TOGETHER

6. 6 ETSI Plugtests  Services  “Interop”, “Bake-off”, “Plugtests” – they are all the same  Improve both quality and interoperability  Debug fast all together  Complementary to standardisation  Can be in the early process.

7. 7 ETSI Plugtests  Services  It is an ETSI Service : Neutral and Open to all other organizations and standards  57 events in +4 years, ~3000 engineers, ~1000 Companies and very good rate of usefulness  no sales, no marketing, no observer attend the meetings

8. 8 What is Plugtests ?  5 Staff coordinating big events with experts from ETSI  Pragmatic extended interoperability tests  Not a laboratory, no certification  Come & Test is our leitmotiv  Saving time !

9. 9 Philippe Cousin The Boss Nathalie Guinet Maria-Luisa Parlatano Patrick Guillemin *new* Maya Ayache

10. 10 Plugtests Set up?  Participants – Implementations – standards or specifications – and Experts  Test case and Test bed at ETSI ?  Scheduling – Test Plan  Rules of engagements

11. 11 18 Plugtests Events in 2004  OSA/Parlay #2  SiPit #14  1st ENUM Workshop  SQTE #3  PKI & XAdES#2  ebXML  UWB  SIGTRAN #4  DSL #3  SQTE #4  IPv6 #5  GRID Universidad de Chile  F-MMS & F-SMS  J2ME  Powerline #2  Smart Card  NGN VoIP CPqD Brazil  2 nd ENUM Workshop

12. 12 Open Source Products & Standards and ETSI Plugtests - 1  With IETF  VoIP : SIP, SIGTRAN using ETSI TCCN Test Suites  ENUM ITU-T, RIPE-NCC and ETSI  IPv6 using ETSI TCCN Test Suites  MIP6 http://mip6.plugtests.org, FreeBSD, MySQL, Apache, IRC, PHP designhttp://mip6.plugtests.org  PKI

13. 13 Open Source Products & Standards and ETSI Plugtests - 2  With W3C and ObjectWeb  XAdES with ETSI TC ESI  GRID (ProActive Java Open Source Middleware), EGEE, CoreGRID, GridCoord (N Queens Contest)  OASIS, UN/CEFACT and CEN/ISSS  ebXML with Open Source Test Service (KorBIT)

14. 14 In 2005, 22 Plugtests Events 1/2  WLAN IRAP (TISPAN) 7-11 February (3GSM)  RFID (ERM TG34) 7-11 March  OSA/PARLAY-X (TISPAN + 3GPP) and Web Serv. 14-18 March with IPT Brazil  NGN@HOME Workshop (TISPAN NGN) 6 April  Open Source Middleware for Mobility Workshop (ObjectWeb, INRIA) 7 April  STQ Mobile (STQ) 18-22 April  ENUM (TISPAN/WG4) 30-May 3-June  F-SMS-MMS (AT, DECT, TISPAN + 3GPP) 27-June 1-July  4th DSL (AT, TM) Lannion 27-June 1-July  IP Monitoring Workshop with IPFIX Plugtests IETF#63 Paris  SIGTRAN (TISPAN NGN + MTS/PTCC) 12-16 September

15. 15 22 Plugtests Events 2/2  Speech Quality Test Event (STQ) 12-16 September  OSA/PARLAY API (TISPAN) 26-30 September  GRID (ObjectWeb, INRIA, EGEE and other IST EC Projects) 10-14 October  IPv6 (MTS + 3GPP) 17-21 October  Mobile Applications (3GPP) 7-10 November  STQ Taiwan (STQ)  WiMAX (BRAN) 14-18 November  Smart Card (SCP + 3GPP) 14-18 November  Powerline (PLT) 21-25 November  Lawful Interception (LI) 28 November – 2 December  Human Factors (HF) 5-9 December  Open Source Plugtests (ObjectWeb) scheduled in Spring 2006

16. 16 Thank You !

17. 17 ETSI European Telecommunications Standards Institute ISDN integrated services digital network GSM Global System for Mobile Communications (cellular phone technology) UMTS Universal Mobile Telecommunications System DECT Digital European Cordless Telecommunication system TETRA TErrestrial TRunked RAdio SAT COM Satellite Communications DVB Digital Video Broadcasting NGN Next Generation Networks VoIP Voice Over IP (Internet Protocols) BRAN Broadband Radio Access Networks Powerline, PLC Powerline Communications : The transmission of information using the existing power IP Cablecom : Internet Protocol Cable Communications SDO Standards Development Organizations OSA Open Service Architecture,Open Service Access SIPIT SIP Interoperability tests SIP Session Initiation Protocol ENUM E.164 Number Mapping SQTE Speech Quality Test Event PKI Public Key Infrastructure XAdES XML Advanced Electronic Signatures ebXML Electronic Business XML (eXtensible Markup UWB Ultra-Wide Band SIGTRAN Signaling Transport DSL Digital Subscriber Line IPv6 Internet Protocol version 6 (current version is version 4) MIP6 Mobile IPv6 GRID Computer Grid (like power grid) SMS Short Message Service MMS Multimedia Message Service J2ME Java 2 Micro Edition IETF The Internet Engineering Task Force TTCN The Testing and Test Control Notation (Tree and Tabular Combined Notation) W3C World Wide Web Consortium TC ESI Technical Committee Electronic Signatures and Infrastructures OASIS Organization for the Advancement of Structured Information Standards CEN/ISSS Information Society Standardization System (European Committee for Standardisation) WLAN Wireless LAN WIMAX Worldwide Interoperability for Microwave Access HF Human Factors