StickyMinds.com and Better Software magazine presents… How to Build a Testing Center of Excellence Sponsored by Cognizant This event aired on July 8, 2008.

Testing centers of Excellence Building © 2007, Cognizant Technology Solutions. Confidential TCOE

© 2007, Cognizant Technology Solutions. Confidential Agenda Testing CoE  Voice of Customers  TCoE Models  Scope  Activities  Critical Success Factors  Key Considerations TCoE Ecosystem Q&A

© 2006, Cognizant Technology Solutions. Confidential Testing is time-consuming No testing value-adds Increasing Business User Demand, Diversified Technologies and locations with different approaches Lack of standards, tools, metrics, templates for quality assessment, comparison across projects Testing in one group is high Inconsistency in testing approach BAs perform the role of QA Testing is expensive © 2007, Cognizant Technology Solutions. Confidential

Testing Process CoE Definition | Development | Maintenance of test processes, standards & templates Facilitation of Test Management Community Metrics Reporting & Management Test Process Training Continuous Process Improvement (CPI) Provision | Administration | Support of Test Infrastructure and Test Tools Provision of NFT Services & Test Automation Services Technical Test Consultancy Provision of Functional, UAT & liaison services Flexible resource pool creation Provision of specialized testing services Testing Tools/ Infrastructure CoE NFT & Automation CoE Shared Testing Team Decentralized centralized © 2007, Cognizant Technology Solutions. Confidential

Process definitions & Roll-out Process facilitation & maintenance Process Compliance Audit Facilitation of Test management community Continuous process improvement Services Assessment of existing process assets Define/Refine and standardize processes Institute metrics framework Usage guidelines and communication plan Establish centralized process framework Pre Setup Activities Organizational strategy alignment Effective Communication & Training Effective Piloting and Evaluation Process compliance review mechanism Critical Success Factors Representation of key stakeholders from various groups Seed change agents to facilitate propagation Closed loop feedback mechanism Key Considerations Testing Process CoE Communicating, Piloting & Training Process audits Change management Industry benchmarking Post Setup © 2007, Cognizant Technology Solutions. Confidential

Tool evaluation Testing tools technical support Test tool license management & administration Tool process standardization Tool optimization Services Tools inventory Tool evaluation Capacity planning & Platform optimization ROI Analysis Tool licensing & procurement policy Pre Setup Activities Clear understanding of opportunities for operational efficiencies Demand forecasting mechanism Tool/Infrastructure utilization & Optimization Service Level Agreements Critical Success Factors Tool standardization for testing activities such as requirement management, defect management etc. Leverage vendor organization’s tool partnership Tool set integration Alternative tool pricing model Key Considerations Infrastructure & Tools CoE Maintain tools inventory Tool administration, upgrades, license management & tools training Monitoring & maintenance Incident management workflow Post Setup © 2007, Cognizant Technology Solutions. Confidential

Review/Refine & publish scripting standards and guidelines Resource sharing & allocation models ROI Analysis Team identification Pre Setup Activities Uniform Automation/Performance Testing guidelines & scripting standards Reusable Automation/Performance testing framework & work load models Defined Non Functional/automation testing requirements Critical Success Factors Scope for Regression & Test Automation based on scheduled releases Utilize Tools CoE for standards & guidelines definition Utilize Process CoE for propagation of best practices Key Considerations NFT & Automation CoE Feasibility analysis & Proof of concepts Construct reusable frameworks Technical Training/Support Technical test consulting Post Setup Services Performance testing Security testing Usability testing Workload Modeling NFT Test Automation Framework design and Implementation Automation Value-Adds Technical consultancy Feasibility analysis © 2007, Cognizant Technology Solutions. Confidential

Establish test management office Scope analysis & demand forecasting Engagement & Sourcing model Institute training program KPI definition Pre Setup Activities Identification of core vs. non-core business functions. Strong Governance Model KPI identifications Management by Metrics Critical Success Factors Tracking mechanism to measure achievements over period of time against established goals Cross-functional training Effective collaboration of Business Analysts and QA Key Considerations Shared Testing Team Resource allocation Skill assessment and training Test program management Construct knowledge assets Post Setup Services Functional testing System testing/SIT Acceptance testing Basic Specialized Support & Consultancy Defect Management Test Life Cycle modeling Test Strategy conceptualization Compliance testing DW testing Agile testing SOA testing Product/Package testing © 2007, Cognizant Technology Solutions. Confidential

Piloting for Success Shared TestingTools Defined basic processes Standardized tool management Defined scope and scheduleTool licensing & procurement policy System Testing System Integration Testing UAT support 3-6 months4-8 weeks HighMedium Data Generation & SanitizationReporting utilities, portlets Knowledge Repository Dash-boards Increased Test CoverageTraceability Established Quality gatesEffective defect management Objective Go/No-Go decisions Improved productivity & test effectiveness Reduced defect leakage Cycle time reduction Quality Gains New project OR AVM ProjectExisting projects Pilot Accelerators Project types Benefit Realization Test Management Management by metrics Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption

© 2007, Cognizant Technology Solutions. Confidential Piloting for Success AutomationNon-functional testing Defined automation scripting standards &guidelines Defined NFT requirements Tools InventoryDefined NFT scripting standards & guidelines Tool EvaluationFeasibility analysis Tool licensing & procurement policy Feasibility Analysis ROI AnalysisPerformance Proof of ConceptsSecurity (Application Vulnerability Assessment & Reusable frameworkUsability Proof of concepts Minimum 4 releases per year6-8 weeks LowMedium Automation frameworkTool driven testing Skilled resourcesLeveraging existing labs Skilled resources ConsistencyIdentifying bottlenecks & vulnerabilities Improved Coverage ReusabilityEnhanced user experience Reduced maintenanceCustomer retention Cost Savings Release-basedNew projects AND Web-based Short-term Long Term Pre-requisites Scope Pilot Length Business Disruption Pilot Accelerators Project types Benefit Realization

Test Planning & Estimation Test Design & Build Test Execution & Management Test Reporting Test Metrics Management Test Program Management Testing Center of Excellence Infrastructure & Tools COE  Tool Maintenance & Support  Test Automation  Tool Implementation  Tool Provision Process COE  Process Maintenance  Process Definition  Metrics Program  Test Process Training  Continuous Process Improvement  Best Practice implementation > > T e s t i n g C e n t e r O f E x c e l l e n c e Service Spectrum System Testing System Integration testing Regression Testing Test Automation UAT Core – Flexible resourcing Standard process & Frameworks Common Tools, Infrastructure & Automation Solution Accelerations/ Best practices Governance structure > TCoE Ecosystem © 2007, Cognizant Technology Solutions. Confidential

Good Luck on your TCOE Journey © 2007, Cognizant Technology Solutions. Confidential

Have a question for the speaker? Ask now. Q & A