1. Research seminar 1. Dr. S. Vilkomir, Research directions in software testing. 2. Brandi Amstutz, Combinatorial Approach to Testing Mobile Applications: An Experimental Investigation. Monday, October 28 2013 Room 232 S&T Bld. 1

2. Research directions in software testing Dr. S. Vilkomir

3. 1. Effectiveness of combinatorial testing for logical expressions 2. Effectiveness of MC/DC 3. Testing mobile applications on different devices

4. 1. Effectiveness of combinatorial testing for logical expressions Combinatorial testing: Each choice Base Choice Pair-wise t-way

5. Pair-wise testing –Dest: London, Paris, Chicago, NY –M: 1000, 2000, 3000 –Direct: Y, N DestMDirect t1L1Y t2L2N t3L3- t4P1- t5P2Y t6P3N t7C1N t8C2- t9C3Y t10N1Y t11N2N t12N3- Pair-Wise: A value of each level for each factor must be combined with a value from every levels for each other factor.

6. Our results Fault Evaluator tool http://core.ecu.edu/STRG/tools.html Four research papers: PSAM 10, Seattle, Washington, USA PIC-2010, Shanghai, China ICST 2012, Montreal, Canada ICSTW 2013,Luxembourg, Luxembourg http://core.ecu.edu/STRG/publications.html

7. New book Introduction to Combinatorial Testing by D. Richard Kuhn, Raghu N. Kacker, and Yu Lei

8. 2. Effectiveness of MC/DC “Independent affect” is the main idea of Modified Condition/Decision Coverage (MC/DC) Suggested in 1992-1994 for avionic software DO-178B. Software Considerations in Airborne Systems and Equipment Certification. USA, 1992. Chilenski, J. and Miller, S. Software Engineering Journal, 1994

9. Modified Condition/Decision Coverage Every point of entry and exit in the program has been invoked at least once, every condition in a decision in the program has taken on all possible outcomes at least once, every decision in the program has taken all possible outcomes at least once, and each condition in a decision has been shown to affect the decision's outcome independently. A condition is shown to affect a decision's outcome independently by varying just that condition while holding fixed all other possible conditions. From DO-178B. 9 3 1 2

10. Do these test cases satisfy MC/DC? –t1: d= 1 –t2: d= 1 –t3: d= 0 –t4: d= 0 Holding conditions – OK Affect the decision's outcome – OK Answer: YES d = A  (B  C) Plans – to continue this research direction

11. 3. Testing mobile applications on different devices Practical questions

13. No scientific approaches No justification Optimal set of devices? Our approach – next presentation