Michael Kass Han Kim Ngo Jacques Durand IIC Test Framework : illustrated on ebXML Conformance Testing

V1.0 May 2003, V1.1 October 2004 An architecture that defines Test Components that work together Test Driver Test Service The IIC [ebXML] Test Framework XML schemas for defining Test Suites Test Requirements executable Test Suites (set of Test Cases)

Interoperability needs to be Maintained between Business Partners Threatened by continuous, non synchronized systems upgrades eBusiness Interoperability is an integration problem: has to be tested “live”, in production Challenges eBusiness / eGov Testing: upgrading

Vision for eBusiness / eGov Testing: The Role of Test Centers Provide testing services at all phases of eBusiness product life cycle Early conformance tests Pre-release Interop tests Business guidelines tests (vertical) Interop Maintenance testing

Conformance to Business Guidelines Application Content Interoperability (A2A) Conformance to Technical Specifications Protocol-level Interoperability Infrastructure System in Production Testing for the “Interoperability Stack”

Vision for eBusiness / eGov Testing: Testing Technology evolving toward: Automation and [XML] scripting Versatile frameworks various formats/standards, evolve with them, ease of customization Support for Testing will become a product feature, not just a QA thing

NIST (US) Test Driver & Test Service. Intended for local testing. 1.1 Available for beta-testing end of year. Test Framework: Implementations KorBIT (Korea) 1.0 Test Driver & Test Service. Used remotely at ETSI test event 2004 (ebMS 2.0). DrakeCertivo (US) Test Driver. Used for ebMS conformance, and also OAG BODs testing KWareSoft (Korea)

ebXML Message Handler Test Service Host 2 ebXML Message Test suite Conformance/ Interoperability report Test Driver Host 1 (or test center ) Test Framework component Test target Testing ebXML MS Conformance

Testing MS Interoperability: point-to-point ebXML Message (HTTP / SMTP) ebXML Message Handler ebXML Message Handler Test Driver Test Service Test suite Test Service Host 2 Host 1 Test Framework component Test target

Provide expertise in conformance testing to OASIS IIC Help develop the OASIS IIC ebXML Testing Framework specification for all ebXML specifications Prototype a Test Framework implementation as proof of concept Assist in writing conformance tests for Messaging, Registry, and Business Process specifications NIST’s Role

Flexible testing architecture Provide simple XML scripting Promote test suite re-use Design Goals

Testing Requirements Executable Test Cases Testing Profile Associated Message Content Test Suite

Reference Conformance Clause in Specification Reference the Normative Specification Broken down into concise Functional (Semantic) Requirements expressed as a Test Assertion Clause Conformance Test Requirements “For conformance to this specification, all the version attributes of any SOAP extension elements defined in this specification MUST have a value of “2.0”

Demo ebXML Messaging Services 2.0 Conformance Test Suite Message Packaging –- # 2 ebXML Message is in root part of MIME Envelope –- #28 MessageHeader version attribute is ‘2.0’

NIST Test Framework Implementation free for download in December at NIST Test Driver and Test Service (source/binary) OASIS IIC ebXML MS 2.0 Conformance Test Suite NIST ebXML RS 2.1 Conformance Test Suite Download