1. TMM I FRAME WORK FOR I NDEPENDENT TESTING GS Raju Mahindra Satyam

2. A GENDA Drivers for Independent Testing TMMi Foundation Test Maturity Model Benefits

3. D RIVERS F OR I NDEPENDENT T ESTING Cost Extensible Delivery Architecture Using Shared licenses Extent of Automation Re-usable test-sets Usage of checklists Pay-per-use models Virtual platforms Crowd-sourcing Quality Risk-based models Peer pressure among service providers Penalty beyond minimum post-delivery defects Tester Performance linked to Delivery Metrics Review Business coverage to catch any gaps in application Time 24x7 operations – Reduction in life-cycle of a project

4. R OAD - MAP FOR I NDEPENDENT T ESTING Low-cost resources Shared resources TMMi Cloud testing Crowd sourcing

5. S HARED S ERVICES – V ALUE P ROPOSITION  20% savings in tools license costs  Reusable assets and frameworks will reduce cost Entry level testers with higher productivity will result in 10 ~ 25 % savings in test execution phase only Infrastructu re (20%) Tools & Frameworks Resources (30%) Resources (30%) Infrastructu re Tools & Frameworks (50%) Resources Based on testing services the overall project cost reduction will be in a range of 12.5% ~ 25 % A regular testing Shop costs 20% for Infrastructure, 30% for Resources and 50% for Tools and Frameworks REGULAR TESTING SHOPREGULAR TESTING SHOP SHARED SERVICESSHARED SERVICES

6. Non-profit organization dedicated to improving testing for everyone Founded by a number of leading test and quality practitioners from across Europe Promote a standard model and international industry standard for assessing and rating organizations' testing process capabilities Persisting feeling that SW-CMM and CMMI models do not investigate the test process areas in sufficient depth TMM i aligns with, and can fully support being used in isolation or alongside CMMI T EST M ATURITY M ODEL I NTEGRATION Richard Sykes (Chair)Andrew GoslinMac MillerFran O'Hara Klaus OlsenGeoff ThompsonErik van VeenendaalBrian Wells The TMMi Foundation Board members are:

7. O BJECTIVES & D ELIVERABLES The TMM i Foundation is a non-profit organization (based in Dublin) dedicated to improving testing for everyone with specific objectives: The following organizations founded the TMMi Foundation Identifying and securing ownership of the TMM i Model Definition of an international core TMM i Model Creation and management of an independent, unbiased central data repository Provision of an independent accreditation process for TMM i ® Assessment Independent assessor training, accreditation, guidelines and examinations Provision of a public forum of interested parties to facilitate free interchange of information, education, ideas and usage of the public standard The Foundation will provide A standard TMM i Model. An independently managed data repository to support TMM i assessment Assessment Method Accreditation/Audit Framework for TMM i assessment Certification and training/examination process.

8. T EST M ATURITY M ODEL Initial Managed Test Policy and Strategy Test Planning Test Monitoring and Control Test Design and Execution Test Environment Defined Test Organization Test Training Program Test Life Cycle and Integration Non-Functional Testing Peer Reviews Management & Measurement Test Measurement Product Quality Evaluation Advanced Peer Reviews Optimization Defect Prevention Test Process Optimization Quality Control Supports testing activities and test process improvement in systems engineering and software engineering Does not provide an approach for test process improvement Provides generic framework as a reference model Addresses all test levels

9. TMM I & CMM I Level Focus Key Process Areas (CMMi Testing)TMMI Level 5 Continuous Process Improvement Improved Test ProcessDefect Prevention Optimizing Defect ManagementTest Process Optimization Quality Control 4 Quantitatively Managed Establish & measure testing process performance Test Measurement Quantitative Managed Peer ReviewsProduct Quality Evaluation Advanced Peer Reviews 3 Process Standardization Standard template for test requirments collectionTest Organization Defined Integration test plans & scheduleTest Training Program Testing Process Test Life Cycle and Integration Non- Functional Testing Peer Reviews 2 Basic Project Management Gathers Testing RequirementsTest Policy and Strategy Managed Testing ScheduleTest Planning Testing ExecutionTest Monitoring and Control Testing Monitoring & ReportingTest Design and Execution 1 Process is informal and Adhoc No Process for Testing Testing is a chaotic, Initial Undefined process

10. TMM I A SSESSMENT & C ERTIFICATION The following organizations have been formally assessed by an accredited assessment provider OrganizationLevel Assessment Provider Certificate Expiry Date LG CNS 3 - DefinedImprove QS B.V. HNDR-738724- 091005- 557520001931-Oct-12 Level 2 - ManagedFully Achieved Level 3 - DefinedFully Achieved Metodos y Tecnologia (MTP) 3 - DefinedExperimentus Ltd WLLB-556857- 101217- 325200008731-Dec-13 Level 2 - ManagedFully Achieved Level 3 - DefinedFully Achieved Home Office IT 2 - ManagedExperimentus Ltd WLLB-556857- 110601- 002470011930-Jun-14 Level 2 - ManagedFully Achieved

11. TMM I & CMM I TMMi complements CMMi Comparison of TMMi and CMMi Levels 2 and 3 show: TMMi covers test-related quality in much greater detail Nearly half of TMMi is not covered by CMMI Non-test Process Areas and Practices elaborated in CMM i are mostly not repeated in TMMi, only referenced To benefit most at higher levels of TMMi needs strong CMMi-like processes across development Value added by TMMi Assesses test more deeply than CMMi Almost 50% of TMMi covers test elements not in CMMi

12. B ENEFITS OF TMM I & I NDEPENDENT T ESTING TMMi processes aligns with organizational and quality objectives early in the improvement model The structure and the generic components of CMMi have been re-used within TMMi Better testing quality and objectivity Independence of a development team so that they are unable to influence testing results Objective, comprehensive, timely data on the developed software enabling you to estimate the real project progress, reveal problems (e.g., divergence from the schedule, budget, planned go-to-market time) and timely mitigate them Proper commitment of vendor's management and development team to your project More business flexibility and efficiency More costs for investment in business expansion or revenue-producing activities Better customer satisfaction