8/27/20151NeST Controlled

2 Communication Transportation Education Banking Home Applications

Defective Software Leads to Loss of market reputation business opportunities 27 August 2015NeST Controlled3 Casualties like injuries and death Loss of Time Loss of Money

8/27/2015NeST Controlled4 What is Testing??

Former Thoughts NeST Controlled5 Establish confidence that a program does what it is supposed to do (Hetzel, 1973)

Former Thoughts NeST Controlled6 The process of executing a program or system with the intent of finding errors (Myers, 1979)

27 August 2015NeST Controlled7 Detecting specification errors and deviations from the specifications Former Thoughts

27 August 2015NeST Controlled8 Verifying that a system satisfies its specified requirements and identifying the differences between expected and actual results Former Thoughts

What could be testing? 27 August 2015NeST Controlled9 Primary role of testing is not demonstration of correct performance, but the exposure of hidden defects G.J.Myers

About Tester Software testers do not make software; they only make them better. Success of an organization depend on the success of testers.

27 August 2015NeST Controlled11 Who is a Tester? A Devil An Angel

Role of Testing Reduction of Errors in operational environment Establishes a specific degree of quality Ensures that industry-specific standards, if required, are met Ensures that contractual or legal requirements are met Ensuring safe operations of mission critical software as in healthcare, space programs Increasing confidence of end users in performance of the software 27 August 2015NeST Controlled12

Testing – A part of Software Lifecycle 27 August 2015NeST Controlled13 "Software Testing Techniques" by Boris Beizer "Software Testing Techniques" by Boris Beizer The thinking that must be done to create a useful test can discover and eliminate bugs before they are coded - indeed, test-design thinking can discover and eliminate bugs at every stage in the creation of software, from conception to specification, to design, coding and the rest

The Challenge 27 August 2015NeST Controlled14 A Miss will result in hit from customer!! The last phase of testing happens at customer site.

The Lacuna 27 August 2015NeST Controlled15 RequirementDesignCodeTesting The Planned RequirementDesignCodeTesting The Actual

The Challenge 27 August 2015NeST Controlled16 Among 22 PAs in CMMI, testing was wrapped into two Process areas alone. Aim is to establish testing as the part and parcel of development lifecycle.

ARRIVAL OF TMMi Earlier testing was unpredictable and hectic. No effective plan, monitor, control & management. To meet high quality standards, high speed, profitability and to reduce cost TMMi was introduced. Earlier testing was unpredictable and hectic. No effective plan, monitor, control & management. To meet high quality standards, high speed, profitability and to reduce cost TMMi was introduced.

TMMi Test Maturity Model Integration. Unmanaged Managed Undefined  Defined Ad-hoc Measured Optimized Helps to meet the business objectives. Open model which incorporates good practices for testing for test process improvement.

Structure of TMMi 5)Optimization Defect prevention Test process Optimization Quality control 5)Optimization Defect prevention Test process Optimization Quality control 4)Measured Test measurement Software quality evaluation Advanced peer reviews 4)Measured Test measurement Software quality evaluation Advanced peer reviews 3)Defined Test organization Test training program Test lifecycle & integration Non-Functional Testing Peer reviews 3)Defined Test organization Test training program Test lifecycle & integration Non-Functional Testing Peer reviews 2)Managed Test policy & Strategy Test planning Test Monitoring & Control Test Design & Execution Test Environment 2)Managed Test policy & Strategy Test planning Test Monitoring & Control Test Design & Execution Test Environment 1)Initial

Managed Existing practices retained during time of stress. 8/27/2015NeST Controlled20 Test Policy & Strategy Test policy based on the business objective Test Planning Test Monitoring & Control Test Design & Execution Test Environment Test plan developed & Test approach is defined in test plan. Cross checks the values with the planned parameters. Identifies test conditions, test cases and test data. Should resemble the real-life situation. Model Requirements

Managed 8/27/2015NeST Controlled21 Effective Implementations Communicate with relevant stakeholders about Test Policy & Strategy By the help of checklist can ensure all the aspects of testing strategies are addressed in the initial stage. Breakdown structure prepared & estimates done for each.

27 August 2015NeST Controlled22 Test Planning Test Plan Test Policy Testing risks Testing objectives Testability Scope of testing Resource availability Testing constraints Criticality

Managed 8/27/2015NeST Controlled23 Effective Implementations Weekly meetings & Milestone analysis Bug Trend Graph

Defined Not just confined to a phase that follows coding 8/27/2015NeST Controlled24 Test Organization Identify & organize a group of highly skilled people for testing. Test Training Program Test Lifecycle & Integration Non-Functional Testing Peer Review Conducts in-house testing certification program & workshops & feed backs collected. Sync test life cycle with development life cycle. Performance, Load, Stress, Usability, Maintainability, Reliability testing are included. Verify requirements met & defects from selected products removed early. Model Requirements Fully integrated to development lifecycle & associated milestone.

Defined 8/27/2015NeST Controlled25 Effective Implementations Training Feedbacks should be collected Tool Failure Mode Effective Analysis is used for risk analysis.

Defined 8/27/2015NeST Controlled26 Effective Implementations Test cases Identified & Prioritized. Different reviews adopted: Formal review Semi-Formal Walk through Different reviews adopted: Formal review Semi-Formal Walk through

Measured Testing is thoroughly defined, well founded and measurable process. 8/27/2015NeST Controlled27 Test Measurement Product Quality Evaluation Advanced Peer Review Identify, collect, analyze and apply measurements. Quantitative understanding of the quality of the product. Peer review(static testing) with dynamic testing. Model Requirements

Measured 8/27/2015NeST Controlled28 Effective Implementations Metrics You can manage, what you can measure You can measure, what you can define You can define, what you understand.

Measured 8/27/2015NeST Controlled29 Effective Implementations Metrics

Measured 8/27/2015NeST Controlled30 Effective Implementations Progress quantitatively managed & measured throughout the lifecycle. Coordination obtained by bi-directional traceability.

Optimized Improving process based on quantitative understanding of statically controlled process. 8/27/2015NeST Controlled31 Defect Prevention Quality Control Test Process Optimization Root cause and common cause of defects analyzed. Statistically controlled & managed test process. Continually improves the existing testing process. Identifies new testing process, tools, methods. Model Requirements

Optimized 8/27/2015NeST Controlled32 Effective Implementations Processes are statistical managed using Process Performance Model. PPM can be built for parameters like test execution rate, testing effectiveness etc. Re-use Test Assets across organization

Process performance models 33 Process Performance Model can be used for Predicting the performance of the identified critical parameter within the project Choosing the quantitative parameters and specification limits for statistical management Testing effectiveness = *Expertise-6.78*Complexity of the product+4.71*% test case executed

PROCESS PERFORMANCE MODELS Testing effectiveness = *Expertise-6.78*Complexity of the product+4.71*% test case executed. Control charts shall be used for quantitative management of the selected sub process parameters inside the project Testing effectiveness = *Expertise-6.78*Complexity of the product+4.71*% test case executed. Control charts shall be used for quantitative management of the selected sub process parameters inside the project 34

Conclusion TMMi helps to bring about greater clarity and an increase in productivity for the activities of the testing phase. By implementing each process areas of testing process efficiently, we can understand the importance of testing throughout the life cycle. 8/27/2015NeST Controlled35

8/27/2015NeST Controlled36

8/27/201537NeST Controlled