1. All-Inclusive Testing in API Management
and Cloud Services
Sameer Chawla – Sr. Test Architect
Puneet Johar – Test Specialist
V. Karthik – Sr. Solution Architect 1

2. Abstract
The API Management Solutions Market Will Quadruple By 2020 As Business Goes Digital – Forrester
Business API Strategy
Minimize
quality and performance issues in production
Increase
user satisfaction, API consumption and adoption
Help
customers achieve their goals easily
All Inclusive Testing in API Management and Cloud Services 2

3. Public Access Assurance Availability Assurance
Total Quality Assurance Management Strategy to Integrate All Aspects of API Management and Cloud Services
Key Business Focus Areas
Secured Exposure of APIs to Public and Partners
Efficient Integration with Legacy and Enterprise Applications
Enhance Enterprise Revenue using API Offerings
Streamlined Process for API Management, Design and Development
Public Access Assurance
API Developer
API Owner
Application Developer
End User
Devices
API Analytics
Developer Portal
API Gateway
Monetization
API Management
Availability Assurance
Enterprise Data
Enterprise Applications
Cloud Services Assurance
Enterprise Legacy 3 4

4. Continuous API Testing Approach to Achieve All Inclusivity
FEEDBACK
SDLC
DESIGN
DEVELOP
DEPLOY
OPERATE
CONTINUOUS TESTING
Static Testing
Isolated Testing
Integrated Testing
Testing in Production
MODEL
Validate Model
Design test scenarios
Create test cases
Identify test data
Automate test cases
Initiate grooming sessions with SMEs
FUNCTIONAL
Smoke Testing
Sanity Testing
Web Services / Microservices Testing
Automated Testing
Orchestrated Testing
CONFIG / DEPLOY
Confirm Configurations
DB Script Executed
Smoke Testing
Validate Critical Business Flows
Approve Successful Deployment
API MONITORING
User Profiling
Performance SLA
Availability
Errors
Server Statistics
Network Statistics
Business Metrics like new subscriptions, unauthorized access etc.
Predictive Analytics
INTEGRATION
Mobile
Web, App
Server
Middleware
Backend
3rd Party Systems / API’s
PRE-REQUISITE
Analyze Requirements
CREATE
Test Strategy
Test Plan
TESTING ACTIVITIES
NON-FUNCTIONAL
Performance Tests
Simulate Backend Load
Test Outlier Conditions
Security / Penetration Testing
CODE
Test using Service Virtualization
Performance Profiling
Static Security Testing
Execute Automated Tests for every CI Build.
API TESTING
Test real-life scenarios
Critical endpoints & service availability
Validate Response data.
Smart Test Design Template
Service Virtualization
TOOLS / TECHNIQUES
Testing in Production Methodology
Predictive Analysis with API Monitoring Data 4

5. Ensure 100% testing requirements coverage
Smart Test Design Template (Sample for Airline)
Test Cases
Scenarios
TC1
TC2
TC3
TC4
Technical
Mandatory 
Format
Functional
Availability
Class
Results
Booking Done
Wrong Date
Flight Not found
Ensure 100% testing requirements coverage 5

6. Testing with Service Virtualization
Shift-left testing for the quality assurance
Enable early automation using virtualized services
Continuous testing for early defect detection
Faster application delivery while mitigating business risk
Why Service Virtualization?
Traditional Testing
Testing with Service Virtualization
Service Virtualization Deployment Process
Execute manual / automated tests
Monitor / improve
Execute
Create SV server
Configure test environments
Implement
Based on need analyzed
Apply rules
Design
Record live transaction
Build new scenarios
Virtualize
Tool Installation and configuration
Configure
Identify need
Select Tool
Analyze 6

7. Why TiP? Testing in Production Methodology Testing in Production (TiP)
‘Production testing is when you are testing a real live system, either about to go live or with live users. It is needed because having software working on the developer’s computer is no guarantee that it will work in the client’s installation.’ (TiP) - WiKi
Why TiP?
Proactive API monitoring
3rd party integrations
Usage of APIs in production
Changes to integrating systems
Prevent potential revenue loss
Testing in Production
(TiP)
Live Production Traffic
Canary Servers
Semantic Monitoring
Test when Usage is Light
Layered Approach
Shadowing 7

8. Predictive Analysis of API Monitoring Data
User Profiling
Performance
Availability
Defects / Error
Unauthorized Access
New subscriptions
Transaction Tracing
Server Details
Network Details
Data Store
Test Analytics
Deep Component
Analytics
Application
Technical Analytics
User Transactional
Business Analytics
QA Intelligence
Root Cause analysis
Preventive
Quality degradation
Prioritize
testing efforts
Analytics based
Risk-driven testing
Defect Prediction
Optimize
Regression Suite 8

9. Benefits High availability and performance of APIs in production
Client data security is maintained
Help in reducing the dependency on third party application readiness for testing
Reduction in test design efforts to maintain sufficient test coverage
Faster deployments to production of critical APIs
Early defect detection 9

10. References & Appendix

11. Author Biography (1/2) Sameer Chawla – Sr. Test Architect
HP Certified automation test professional with 11+ years of rich industry experience
Presently working in the role of a Senior Test Architect with responsibilities of:
Test Automation, PoC Creation
Test Team Management & Technical Training
MCA from M.D.U.
Puneet Johar – Test Specialist
Software Testing and Airline domain expertise with 10 years of rich industry experience
Presently working in the role of a Test Specialist with responsibilities of:
Manual Testing
Team Handling & Creating PoCs
Functional Training & helping team to achieve required goal.
MCA from Bangalore University.

12. MBA in from Symbiosis, Pune
Author Biography (2/2)
V. Karthik – Sr. Solution Architect
An accomplished Test Architect with demonstrated success in managing large and complex Testing projects across multiple geographies having 17+ years of IT experience.
Outstanding performer in Software QA delivery roles, dedicated to building highly successful teams, Innovation and directing high-impact cost-effective testing strategies and frameworks.
Proven ability to implement processes and methodologies that decreases cost, increases performance and positively affects the bottom-line.
MBA in from Symbiosis, Pune
MCA from IGNOU