Improving the ICM Test Planning and Identification Qian Wu April 23,2010

Agenda A good test model Current approach Problems New approach Benefits References 1

A Good Test Model : 1) can effectively combine a series of activities. 2) can adapt to each kind of software system with different functions. 3) can find errors in the software design as early as possible. 2

Current Approach Test Plan and Cases Test Procedures and Results Regression Test Package 3

Current Approach AssignmentDue Date VC Package09/21/09 FC Package10/26/09 Draft DC Package11/23/09 DC Package (ATCP)12/07/09 RDC Package2/22/10 CCD,TRR,IOC….… 4

Test Cases could be identified by using the following structure: Test Identifier: This identifies the test by a project unique identifier and test case name. It shall provide a brief description of the test Test Level : describe the level at which the testing will be performed, for example, software item level or system performance (level of service) level. Test Class : describe the type or class of the test that will be performed, for example, timing tests, erroneous tests, maximum capacity tests, etc. Test Completion Criteria: list of completion criteria specific for this test identifier Test Cases: A test case specification specifies inputs, expected results, and a set of execution conditions for a test item. For each test case, create a sub-heading using the following structure: Identify a test (one of the tests in the test set comprising the application testing addressed by this test description) by a project-unique identifier and provide the information specified below for the test. The name includes the identification of the applicable unit. There may be several test cases for one test identifier. 5

Current Approach Problems: Develop test plan and test cases too late No enough detail in test case identifying 6

New Approach Develop Condition tree Develop Behavior tree Assignment Draft DC Package DC Package(ATCP) 7 Assignment Draft DC Package (ATCP) DC Package

New Approach 8

Condition tree Shields for Family Basic Condition CG1 Account C11 Account ID C12 Password C13 Status C14 Role C15 Real Name C16 Employee ID C17 CG2 … 9

New Approach 10

Behavior tree Shields for Family Basic Function BG1 Login BG11 Login successfully B111 Correct ID B112 Correct Password BG12 Failure Login B121 Incorrect ID B122 Incorrect Password B123 Deactivate Account BG2 Add Account … 11

Benefits Develop test process earlier then current approach Provide a guideline for test case identifying More efficient in choosing the test cases of regression test 12

Reference ICM Yongzhong Lu, ”Research on a Behavior-Based Software Test Process Model“, IEEE Transactions on Software Engineering, pp , 2008 J. S. Gourlay, “A Mathematical Framework for the Investigation of Testing. IEEE Transactions on Software Engineering, vol. 12, pp , J. C. Huang, “An Introduction to Program Testing”, ACM Computing Surveys, vol. 7, no. 3, Sept. 1975, pp