1. One Digital – Integrated Digital Assurance Automation Framework
Vinod Sundararaju Antony, Director – Projects
Vinoth Balasubramanian, Senior Manager – Projects
Ankur Joshi, Manager – Business Development
Cognizant Technology Solutions

2. Defining One Digital
One Digital - Integrated Digital Assurance Automation Framework provides a common automation framework leveraging open source toolsets across digital platforms (web &mobile) & testing phases (functional, performance, security and accessibility).
Optimized Team
Reduced Effort
Intelligence
Faster Time to Market
Eliminates need for separate teams across testing types
Reduced script design and maintenance effort
Brings in intelligence in the form of self-diagnostics and self-recovery
Reduced test cycle time due to parallel execution (cross browser, across testing types)

3. Before One Digital Implementation Fix only functional defects
Sprint N  Sprint N + 1
Day 1 to Day 15
Hardening Sprint
Release
Coding, Unit Testing & Build Deploy
Defect Fixing, Unit Testing & Build Deploy
Retrospection & Demo
Fix only functional defects
Test Script Design
Performance Testing
Defect Re-Testing
Functional Test Execution
Sequential Execution
Security
Testing
Test Script Design – Hardening Team (performance, security, accessibility )
Accessibility Testing
Release - Day 20
Separate and duplicated effort due to different tools
Wait Time for Non-Functional Execution
Separate Teams
Legend
Performance
Functional
Security
Accessibility 3

4. After One Digital Implementation
Sprint N  Sprint N + 1
Day 1 to Day 15
Hardening Sprint
Release
Coding, Unit Testing & Build Deploy
Defect Fixing, Unit Testing & Build Deploy
Retrospection & Demo
Fix only functional defects
Fix only functional defects
Fix Functional & Non-Functional Defects
Test Script Design
Performance Testing
Security
Testing
Accessibility Testing
Defect Re-Testing
Functional Test Execution
Sequential Execution
Parallel Execution
Sequential Execution
Post Build Stability
Test Script Design – Hardening Team (performance, security, accessibility )
Release - Day 15
Eliminate/ Minimize Hardening Sprint to Reduce Cycle Time
Separate and duplicated effort due to different tools
Single Test Script Design
Separate and duplicated effort due to different tools
Wait Time for Non-Functional Execution
Wait Time for Non-Functional Execution
Early Defect Detection
Separate Teams
Separate Teams
One QA Team
Legend
Performance
QA Team
Functional
Security
Accessibility 4

5. One Digital - iDAAF Architecture
Digital Controller
Event Handler
Test Script
Digital Package
Execution platforms
Application Under Test
Reports
Enriched UI Report using Extent Report API
Service Validation Libraries
Accessibility
Security
Performance
Reporting Libraries
Error & Exception Handler
Self Diagnostic and Self Healing Module
Support Libraries
Common Libraries for Web, Web service, Mobile
Driver Script
CI Based Execution
Test Script
Test Package
Mobile

6. One Digital – Behind the scenes
Digital Package
Digital Controller
Event Handler
Method:
1. Method for Webdriver initiation and Eventfiring driver initiation(for web/Mobile)
2. Passing the control of webdriver to eventfiring driver so that event handlers can fire the action based on the event signal
eventDriver = new EventFiringWebDriver(driver);
eventDriver.get("
handler = new EventHandler();
eventDriver.register(handler);
Method
Sample of event handler methods.
Method to check the accessibility guide line
afterClickOn(WebElement arg0, WebDriver arg1) {
accessibility1();
accessibility2();
runJmeter();
securityTest();// ZAPProxy settings,run
runWebservice(); }
Reports
Execution Platforms
Accessibility, performance, security, mobile automation methods are automatically called after driver navigates to new page
Test Package
Test Script

8. Sample Reports

9. Open Source Tool Stack for the Framework
One Digital – Coverage
What is covered ?
Limitations of the Framework
Workarounds
Functional / Regression
Mobile Web Testing
Early Performance Testing
Single User Performance Test
Load Test
Security Testing (Vulnerability Assessment)
Accessibility Testing (WCAG guidelines)
Accessibility
Verifying that text alternatives are meaningful can only be accomplished by manual review
Keyboard access can only be confirmed by a tester taking the steps to evaluate those functions
Performance
Jmeter is not designed to long-polling application testing however you can test it with certain restrictions
Accessibility
Using NVDA speech viewer, content can be verified manually
Quick keys and NVDA Keyboard layouts can be used
Performance
Solutions such as Blazemeter to be leveraged for running Jmeter script
Open Source Tool Stack for the Framework

10. One Digital in Action PROBLEM STATEMENT SOLUTION OUTCOMES ~20%
Separate QA cycles for functional and non-functional - need to operate two teams, one aligned to sprint and a full capacity shared team for release level execution
Wait time for the release level non-functional testing led to increased cycle time
Additional effort for managing different tools and scripts
Functional and non-functional use cases critical for the release were identified
Integrated Automation Framework was established to bring together all testing types, for non-functional testing open source tools were leveraged to bring in specific libraries
OUTCOMES
Shared capacity of 9 resources was reduced to 7 and the release level activities as part of shared team were running with a smaller team
Defects pertaining to non-functional aspects were detected in-sprint due to early performance and security test execution (On an average 3 out of 6 NFT defects uncovered during sprints)
Release duration was reduced to 15 Days from 20 days due to minimized hardening sprint
~20%
REDUCTION IN TEST EFFORT
ENHANCED QUALITY
THROUGH EARLY DEFECT DETECTION
~ 25%
REDUCTION IN CYCLE TIME

11. …Thank You!!! Bibliography
The Forrester Wave™: Modern Application Functional Test Automation Tools, Q4 2016
IDC FutureScape: Worldwide IT Industry 2017 Predictions
Hootsuite – Device Usage (Jan 2017)
Infographicsme.com – The Digital Revolution
…Thank You!!!

12. Question & Answers