1. Testing Dr. Andrew Wallace PhD BEng(hons) EurIng andrew.wallace@cs.umu.se

2. Overview Aims Testing Static Testing Dynamic Testing

3. Aims Correctness (verification) Requirements Time Space Reliability (validation) Maintainability (regression)

4. Aims Test each module / function Integrate and test larger units Test whole program

5. Aims Formal reviews Standards Measurements

6. Testing What to test for? What can be tested for? What does the test actually tell us? When to test?

7. Testing Static Testing Analysis the code Logical analysis Dynamic Testing Running the code Debugging

8. Static Testing Informal Look through the code Get someone else to do it! Check standards Check loops / reachability Check variables Check documentation

9. Static Testing Metrics Code size Lines of code Lines of comments 5.5 errors per 1 000 lines of code Complexity

10. Dynamic Testing input Code to Test Measured response

11. Dynamic Testing Software specification Test Cases Test Scripts Desired results Code execution Compare results

12. Dynamic Testing Test cases? Derived from specification Valid input? Invalid input? > max? < min? Test plan? Memory leaks?

13. Dynamic Testing Coverage Statement coverage Sc = s/S (s = statements executed, S= total number of statements) Decision coverage Dc = d/D (d = number of decision evaluated, D = total number of possible decisions) Path coverage Pc = p/P (p = number of paths executed, P = total number of paths)

14. Boxes Black box White box

15. Questions