1. AutomIQ Inc. Proprietary & Confidential – DO NOT DISTRIBUTE
Autonomous Testing: Journey Beyond Continuous Testing
May 8, 2018
SQuAD Presentation
Becky Karch
11/18/2018
AutomIQ Inc. Proprietary & Confidential – DO NOT DISTRIBUTE

2. Confidential - Do Not Distribute
Today’s Reality
IRS Technology Collapses on Tax Day!
Equifax Massive Data Breach!
British Airways Global IT Failure!
Nest – Software Update Gone Wrong!
Twitter – User Passwords Stored in Plain Text
11/18/2018
Confidential - Do Not Distribute

3. Confidential - Do Not Distribute
What Has Changed?
Platforms Have Evolved
Struggles to Automate Remain the Same
Cloud
Automated
Testing
Mobile
Test Data
Release
Management
Agile
Continuous Development
DevOps
Mainframe
Continuous Delivery
Client/Server
11/18/2018
Confidential - Do Not Distribute

4. What are you experiencing?
What do you feel matters most in your organization:
Quality
Time to Market
Cost
11/18/2018
Confidential - Do Not Distribute

5. Quality Matters In Releasing Software
47%
Quality
top
priority
45%
Time to
market
top priority 8%
Cost reduction
top priority
Source: voke Market SnapshotTM Report: Release Management
11/18/2018

6. What are you experiencing?
Is your Organization doing continuous development and/or deployment?
Continuous Integration
Continuous Deployment to Test
Continuous Deployment to Production
11/18/2018
Confidential - Do Not Distribute

7. Continuous Integration & Deployment is Still a Dream
34%
Continuous
Integration
of Software
Changes
23%
Continuous
Deployment to
Test Lab 9%
Continuous
Deployment to
Production
Source: voke Market SnapshotTM Report: Release Management
11/18/2018

8. What are you experiencing?
Where is the majority of your / your tester’s time spent?
Functional Testing
Non-functional Testing
11/18/2018
Confidential - Do Not Distribute

9. What are Testers Spending Their Time On
Majority of time spent on Functional Testing due to rapidly- changing feature/function set
Waiting for requirements
Waiting for test data
Coding automated scripts
Maintaining automated scripts
Manual testing
No money, time left for non-functional testing
11/18/2018
Confidential - Do Not Distribute

10. Manual testing is still too popular
Data Shows
64%
Manual
functional
testing
47%
Manual
integration
testing
Manual testing is still too popular
Automated Testing is Lagging
53%
Automated Functional Testing
44%
Automated
integration
testing
Test Data is a Significant Issue
86%
Lack of production
data
11/18/2018
Source: voke Market SnapshotTM Report: Release Management

11. QA “Utopia” Minimize technical and testing debt
Continuous Delivery/Release
Minimize technical and testing debt
Clear, consistent communication
Reliable, scalable SDLC
Customer Advocacy
End-to-end customer tests
Obtain user input
Minimize customer down-time and support tickets
Measure & Analyze
Alignment within organization
Cross product/team coordination
Build enterprise-wide influence
11/18/2018
Confidential - Do Not Distribute

12. The Manual Software Test Lifecycle is Crippling
Requirements
Test Plan
Status of Quality
Results
Test
Cases
Most of the software testing lifecycle remains manual
Without Automation, QA is forced to be reactive instead of proactive
Software Test
Lifecycle
Defects
Test Scripts
Test Data
Test Execution
Test Environment
Automated
Manual
11/18/2018
Confidential - Do Not Distribute

13. Defining Autonomous Testing
Eliminate traditional bottlenecks using Artificial Intelligence to do the work for you.
Dynamically train software to create test cases, test scripts, test data, and defect reports and you can finally keep up with development!
The right tool allows you to leverage your skills to achieve QA Utopia
11/18/2018
Confidential - Do Not Distribute

14. Bringing AI to Software Testing
Traditional
Approach
Test Suite Written in English
Read Test Cases
Test Manually
Write Selenium Scripts
Manually Generate Data
Manually Execute Tests
Autonomous
Testing
Test Suite Written in English
AI Processes Test Suite
Create Scripts, Data, and Execute Tests at the Click of a Button
Autonomous testing takes the test cycle from weeks to minutes
11/18/2018
Confidential - Do Not Distribute

15. Test Script and Test Data Creation
Application Under Test
Executable Test Scripts
SaaS
Web
API/
Microservice
Test Assets
Discover Application
AI Processes Test Cases
Generate Test Data
Generate Test Scripts
11/18/2018
Confidential - Do Not Distribute

16. Tools for Organizational Effectiveness
Key Features
Cross Enterprise
Dashboard
Change Impact
Analysis
Measure quality
Measure Return on Investment (ROI)
Ensure budget accuracy
Promote cross-organization parity
11/18/2018
Confidential - Do Not Distribute

17. Tools for Technology/Innovation
Key Features
Leverage AI,
ML, NLP
Training
Application
Test Architecture
Exploratory Testing
Autonomous Testing
Security Testing
Performance Testing
Unit Testing
Service Virtualization
11/18/2018
Confidential - Do Not Distribute

18. Tools for Customer Advocacy
Spend more time being voice for customer
Improve collaboration across scrum and lean teams
Lead the effort on non-functional requirements for performance, security, architectural stability, and integration
Automatic
Scripting
Synthetic
Test Data
Key Features
11/18/2018
Confidential - Do Not Distribute

19. Autonomous Testing Engineers the Testing Lifecycle for Quality
Requirements
Test Plan
Status of Quality
Results
Test
Cases
Most of the software testing lifecycle is autonomous
More time for non-functional testing
QA “Utopia” is achieved
Autonomous
Testing
Defects
Test Scripts
Test Data
Test Execution
Test Environment
Automated
Manual
11/18/2018
Confidential - Do Not Distribute