1. Software Testing Test Design and Implementation

2. Agenda Test Design Test Implementation Test Design Sources Automated Testing 2

3. The Testing Process 3 Planning and Design for testing is done in all phases of software development. Determine the test methodology Planning the tests Designing the tests Performing the tests Test Methodology Software Test Plan Detailed Design Test Case DB / File

4. Software Test Plan (STP) Scope of the Test  S/W Package to be tested – name, version  Document reference for the planned tests Testing Environment  Testing Site  Required H/W Config  Participating Organizations  Manpower Requirements  Team Preparation – Training Test Details (for each test)  Test ID  Test Objective  Reference to the Requirements Document (SRS)  Test Class  Test Level (Unit, Integration, System)  Test Case Requirement  Data to be Recorder 4

5. Software Test Plan (STP) Test Schedule  Preparation  Testing  Error Correction  Regression Tests 5

6. Test Design Output  Software Test Procedure  Test Case File Documented in “Software Test Description” 6

7. Software Test Description (STD) Scope of the Test  S/W Package to be tested – name, version  Document reference for the planned tests Testing Environment (for each test)  Test ID  Description of the H/W and OS Config.  Instructions for S/W Loading (Setup) Test Process  Instructions for input  Data to be Recorded Test Cases (for each test case)  Test Case ID  Input Data and System Setting  Expected Result Actions to be taken in case of failure 7

8. Test Implementation  Test is carried out as mentioned in the STD  Identify and Fix the Errors  Regression Test (re-test) to check if the errors are removed  Check whether no new bugs were added when correcting  Repeat the correction-regression testing cycle until satisfactory results are achieved  Document the results in a report called Software Test Report (STR) 8

9. Software Test Report (STR) Test Details  Software ID, Test Site  Time of Start and End of Tests,  Test Team Members, Other Participants,  Time Taken for Test Test Environment  Hardware Config.  Prep and Training before the test Test Results  Test ID  Test Case Results (for each test case)  Test Case ID  Tester ID  Results  Description if failed 9

10. Software Test Report (STR) Summary Tables  Total Errors  Their Distribution  Types of Errors Special Cases  Special Issues during the test implementation  Problems identified during testing  Proposal to change test environment  Proposal to change test procedure and test case files 10 Note: Summary of tests is documented in Test Summary Report (TSR)

11. Test Implementation Phase 11 Test Design STD Testing Is Quality Accepta ble? Correct Errors Regression Test End STR TSR NO YES STR TSR

12. Test Design Components 12 TEST Test Case * Data Inputs Operating Conditions Expected Results Test IDTest Case ID InputConditionExpectedActual

13. Example of Test Design 13 Let say the tax on a property is based on the following factors S => Size of the apartment N => Number of people living in the apartment A, B, or C => Location Classification If A = > Tax = (100*S)/(N+8) If B => Tax = (80*S)/(N+8) If C => Tax = (50*S) / (N+8) Test ID Test Case ID InputConditionExpectedActual 11.1S=250 Class A People 2 $2500 1.2S=180 Class B People 4 $1200 1.3S=98 Class C People 6 $350

14. Test Case Sources 14 Sources Real-Life CasesSynthetic Cases Random Samples Simulated Cases Created by Test Designers Based on Experience Cases that have high probability of failure

15. Sources for Test Cases 15 Real-life CaseSynthetic Case Effort Required to Prepare Test Low EffortHigh Effort Required Size of Test Case File Relatively HighRelatively Small Efforts Required to Perform Test High EffortLow Efforts EffectivenessRelatively Low – Low coverage Ability to identify unexpected errors Relatively High Good Coverage Unexpected situations cannot be considered

16. Automated Testing Integration of computerized tools into the process of Software Development (or Testing specifically)  Cost Savings  Shorten Test Duration  Detailed Performance of Tests  Improvement of Test Accuracy  Improvement in Result Reporting Automated Testing Activities  Same as what we discussed earlier  Planning, Design, Test Case Prep, Implementation, Log, Report Prep, Regression Testing, Final Report 16

17. Automated Testing Types of Automated Testing  Code Auditing  Check whether code complies with standards and Procedures  Remember HTML Validation in Web-based Systems  Coverage Monitoring  Line coverage achieved when designing test cases. Percentage of lines covered and not-covered.  Functional Tests  Record Black-Box Tests and perform them automatically  Example: Junit for Unit Testing Java Modules  Load Tests  Test the system under maximum load.  Test Management 17

18. Automated Testing Advantages Accuracy and Completeness of Performance Accuracy of Result Log and Reports Comprehensive Information Few manpower Short duration of testing Perform complete regression testing Disadvantages High Investment High development cost High manpower requirement for test prep Do not cover all areas of testing. Many needs to be done manually 18