1. © 2000 D EMO D AY 2000 Page 1 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Leïla Charfi, Luigi Logrippo & group (with RL Probert & group) School of Information Technology and Engineering University of Ottawa Participants “Fast Spec-to-Test” Project University of Ottawa Mitel Corporation

2. © 2000 D EMO D AY 2000 Page 2 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Objectives u The Problem: Obtaining tests that cover the requirements u Automatic functional test generation – by developing automatic test purpose generation from requirements Use Case Maps (UCM)  LOTOS u Proposition of a design methodology with automatic test suite generation: u UCM at requirements stage u LOTOS at design & prototyping stage u Automatic LOTOS test purpose generation from UCM u Automatic test suite generation from LOTOS

3. © 2000 D EMO D AY 2000 Page 3 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Design Methodology for Telecommunication Systems Use Case Maps Requirements stage LOTOS specification Design stage LOTOS scenarios verification, validation and test suite generation Test suites Mapping UCM to LOTOS statements (1) (2) (3) (4) Implementation stage Test suite execution on Implementation MSCs lotos2msc msc2lotos Input for possible SDL specification,...

4. © 2000 D EMO D AY 2000 Page 4 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Use Case Maps (UCM) u Semi-formal notation, used at requirement stage u Visual representation of system’s behavior u Derived from informal requirements or use cases start point responsibility end point Example of map: simple call establishment component stub offHookdial onHook phoneA phoneB switch checkIfIdle offHook [Idle] [busy] or_fork disconnection checkCalleesStatus

5. © 2000 D EMO D AY 2000 Page 5 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology LOTOS – Formal Description Technique – Design of telecommunication systems – Validation tools: interactive simulation (step-by-step execution), validation using test conformance on the specification u LOLA u XELUDO u CEASAR – Test generation tools u UCM2LotosTests: LOTOS scenario generation from UCM u TGV: test suite generation from LOTOS scenarios u TorX: test generation and execution of test suites Language Of Temporal Ordering Specification

6. © 2000 D EMO D AY 2000 Page 6 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology UCM to LOTOS mapping (1) UCM elements LOTOS elements map, componentprocess stub start-point responsibilityaction end-point or-forkchoice operator [] and-forkparallel composition

7. © 2000 D EMO D AY 2000 Page 7 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology UCM2LOTOSTests (1) (2) Process Calle_Busy[ user_to_phone, phone_to_user] :exit Test generation algorithm generates 2 scenarios UCM to LOTOS scenario transformation offHook dial onHook dial checkIfIdle offHook dial offHook [busy] [Idle] disconnection user_to_phone !A !phoneA !offHook; phone_to_user !phoneA !A !dialTone; user_to_phone !A !phoneA !dial !B; phone_to_user !phoneA !A! busyTone; user_to_phone !A !phoneA !onHook; endProc user_to_phone !A !phoneA !offHook; phone_to_user !phoneA !A !dialTone; user_to_phone !A !phoneA !dial !B; phone_to_user !phoneB !B ! ringTone; user_to_phone !B !phoneB ! offHook; ( user_to_phone !A !phoneA !onHook; phone_to_user !phoneB !B !disconnectTone; user_to_phone !B !phoneB !onHook; [] user_to_phone !A !phoneA !onHook; phone_to_user !phoneB !B !disconnectTone; user_to_phone !B !phoneB !onHook) endProc Process Calle_Idle [ user_to_phone, phone_to_user]: exit checkCalleesStatus checkIfIdle [Idle] [busy] checkCalleesStatus phoneA phoneB switch phoneAphoneB switch Aim: covering the UCM with test cases

8. © 2000 D EMO D AY 2000 Page 8 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Test Purpose (MSC format) Message Sequence Chart offHook dialTone dial[B] ring userAdebA Test purpose: - Abstract description of a subset of the specification - Tests the functional behavior of the specification against its expected behavior debB userB ringTone offHook answer onHook disconnection onHook

9. © 2000 D EMO D AY 2000 Page 9 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Test suite generation with TGV (3) (4) Test purpose Test suite generated from LOTOS using TGV 0 1 user_to_phone !A !offHook phone_to_user !A !dialTone 2 user_to_phone !A !dial !B 3 phone_to_user !B !ringingOn 4 phone_to_user !B !ringBackTone 5 user_to_phone !B !offHook 6 phone_to_user !A !ringBackToneOff 7 user_to_phone !B !onHook 8 phone_to_user !A !disconnectTone 9 user_to_phone !A !onHook 10 TGV 0 1 user_to_phone !A !offHook; INPUT phone_to_user !A !dialTone; OUTPUT 3 user_to_phone !A !dial !B; INPUT 5 phone_to_user !B !ringingOn; OUTPUT 7 phone_to_user !B !ringBackTone; OUTPUT 8 user_to_phone !B !offHook; INPUT 9 phone_to_user !A !ringBackToneOff; OUTPUT 11 user_to_phone !A !onHook 11 phone_to_user !B !disconnectTone 12 user_to_phone !B !onHook user_to_phone !B !offHook (INCONCLUSIVE) 2 4 6 user_to_phone !B !onHook; INPUT 13 phone_to_user !A !disconnectTone; OUTPUT 15 user_to_phone !A !onHook; INPUT(PASS) 17 user_to_phone !A !onHook; INPUT 14 phone_to_user !B !disconnectTone; OUTPUT 16 user_to_phone !B !onHook; INPUT(PASS) user_to_phone !B !onHook (INCONCLUSIVE) 12 user_to_phone !A !offHook (INCONCLUSIVE) 10 18

10. © 2000 D EMO D AY 2000 Page 10 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Conformance relation used by TGV The Implementation can have more inputs The Specification can have more outputs I: implementation, S: specification I ioconf S  traces(S), O(I after  )  O(S after  ) I1I1 I2I2 I 2 not ioconf S switch? checkIfIdle phone2! idle phone2! busy switch? checkForward I 1 ioconf S switch? checkIfIdle phone2! idle phone2! busy switch !indefinedUsr switch? checkIfIdle phone2! idle phone2! busy S

11. © 2000 D EMO D AY 2000 Page 11 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Success to date and Lessons Learned u Use of UCM to formalize requirements:  Automatic test generation with full coverage of the UCM (implying full coverage of the requirements)  Easy derivation of a prototype using the UCM to LOTOS mapping

12. © 2000 D EMO D AY 2000 Page 12 Automatic Generation of Conformance Test Cases from Use Case Maps Strategic Technology Key Issues u How to design UCMs so as to facilitate requirement documentation and obtention of meaningful test case u Automating as much as possible UCM to LOTOS translation u More experience is needed...