1. Adaptive Testing Technique Ajay Chhokra and Jitender Danwani

2. www.Test2008.in 2 Trends Business complexities and globalization of business are impacting Types of initiatives supported by software delivery Process of software delivery Software Testing Today is different than what it was 10 years ago and will be different 10 years from now…….. Facts contributing in Trends are Technology SOA, Distributed Technology, Web Technology SOA, Distributed Technology, Web Methodology Rapid Development, Agile Methodology Rapid Development, Agile Customer Expectation Cost, Time, Reliability and Robustness Customer Expectation Cost, Time, Reliability and Robustness

3. www.Test2008.in 3 Business Movers and Shakers DriversExpectationsEffects on Time to MarketReduce Cycle TimeRevenue Competitive Edge QualityDefect Density, Reliability and High Test Coverage Customer Satisfaction Market Share Revenue CostMaximum and Quick ROI Pressure on reducing Testing Effort Quality EmployeeSmart TestingEmployee Morale

4. www.Test2008.in 4 Key Message - Reduce Cycle Time - Smart Testing Test Reduction Techniques

5. www.Test2008.in 5 Test Reduction – Analysis Testing effort is 30 – 40% of the complete project development Life cycle Functional testing is most widely used testing type. Functional testing involves applying various user inputs. Functional testing is most widely used testing type. Functional testing involves applying various user inputs. Number of possible Test inputs is very large for complex projects. Testers select limited set of test cases Number of possible Test inputs is very large for complex projects. Testers select limited set of test cases Most of functional testing is done in an intuitive manner Test Reduction is must for regression tests to increase productivity

6. www.Test2008.in 6 Test Reduction Techniques Risk based Testing Pair-wise Testing Cycle Based Testing

7. www.Test2008.in 7 Risk based Testing PositivesNegatives Focus on the key business areas/critical business processes Eliminates the major risks Quick to apply if the tester and business have good exposure to business domain Identifying the business risks precisely is difficult ( Requires clear understanding of applications and business and detailed knowledge of requirements ) Technique focuses on the key risks and often ignores the low impact areas. Technique is not foolproof; it is more or less intuitive in nature.

8. www.Test2008.in 8 Pair-wise Testing PositivesNegatives Reduce the test cases drastically at 2 and 3- level interactions Helpful for complex systems that involve large number of parameters and their combination Suitable for regression cases where coverage is to be maintained high with minimal cases count The defect detection rate versus the applied effort is high. Chance of undetected defects at lower level interaction is more than higher order interaction With number of interaction levels increases, the number of cases increases very significantly Pairwise testing fails when the parameters and levels have not been appropriately identified. Pairwise testing (primarily focusing on 2 – way implementation) does not cover all input space.

9. www.Test2008.in 9 Cycle Based Testing PositivesNegatives Gives good visibility on Testing progress Helps to define logical milestone for testing. The defect fixes or patches applied are tested in subsequent cycles. Very helpful when applying Incremental Integration techniques Technique is discouraged when individual test cycles are too long. May involve overheads if repeated data setup is required in every subsequent cycle. Too many cycles in single release delays the process. Tracking the execution, defects and cross- impact is sometimes difficult when using this technique.

10. www.Test2008.in 10 Adaptive Testing A Technique developed to adapt to various project needs. Well suited for specific project needs – reducing time or increasing test coverage etc. Adaptive techniques can be combination of various market proven techniques such as Risk Based testing, Pairwise testing etc tailored per project needs. What is Adaptive Testing ?

11. www.Test2008.in 11 Why Adaptive Testing ? 1. Cycle based testing fails and proves Overhead when too many cycles involved, each requiring fresh data or environmental setups. - Adaptive testing helps control the need of multiple cycles 2. Pairwise testing – Its a popular test reduction technique but is effective at low level interactions. - Adaptive technique can help focus on multi-level interaction thereby reducing risk of low coverage 3. Risk based testing often fails to provide complete coverage in large projects. - Adaptive techniques can ensure that maximum risks are covered giving high coverage 4. Adaptive testing draws a fair balance between the test coverage, the risk and the time to market the quality product.

12. www.Test2008.in 12 How to Apply Adaptive Techniques ? Steps to Apply Adaptive Techniques Step 1: Identify the most significant parameters (ones that have prime impact on business) The various parameters could be complexity of application defined quality goals business priority and impact time to market delivery timelines system knowledge Step 2: Analyze the individual techniques that can best fulfill the business needs. Step 3: Tailor the individual techniques or apply Mix-n-Match to make it adapt to project needs Step 4: Analyze the results and continue tailoring, if needed Note : Once you are familiar with how to apply Adaptive techniques, the effort required for tailoring is drastically reduced.

13. www.Test2008.in 13 How to Apply Adaptive Techniques? The Mix-n-Match of the individual techniques can help project have different FLAVORS of adaptive testing. Each Case below is project specific and business objective based. Case 1: Risk Based + Pairwise Test Define the parameters and levels of interaction Identify the high impact condition using RBT Apply Pairwise technique on less/ low impacting parameters Case 2: Risk Based + Cycle Based Test Identify the high impact and low impact business condition Define multiple cycles Distribute the high impact and low impact functionalities over cycles based on priorities Case 3: Pairwise Test + Cycle Based Test Identify parameters and levels Apply Pairwise technique to arrive at reduced test set Prioritize the test cases Distribute the test cases in various cycles – sanity, priority and retest

14. www.Test2008.in 14 Benefits and Challenges – Adaptive TechniquesBenefits Can be applied to varied project scenarios or type of testing – regression, enhancement, system, integration testing etc Adaptive techniques are fool proof and help to identify hidden defects Focus is on high coverage and critical business functions simultaneously Can be universally applied in product based releases cycles High probability of defect detection. Challenges Requires good knowledge of system & market techniques (Pairwise, combinatorial, risk based techniques etc) Need analytical capabilities in determining how to Mix-n-Match or tailor the techniques Change sin business process necessitate revision of test cases and re-assess risk associated

15. www.Test2008.in 15 Case Study Risk-Based Technique Pairwise Technique Adaptive Technique Reduced Test Cases 32 1632 Defects Found 859 Test Reduction (%) 97.2%98.6%97.2% Exhaustive Test Case Count = 1152 UHG India Experience – Case Study