1. Presentation www.sp-assurance.com As presented June 9, 2014 Mobile App Testing Strategy SOFTWARE ASSURANCE, LLC

2. Mobile Evolution www.sp-assurance.com As presented June 9, 2014

3. Mobile Evolution An average consumer spends 127 minutes a day on the mobile phone There are 4.5 times as many mobile devices in use as there are PCs 49% of mobile users in the US now have smart phones and this number is going up at a very rapid rate Mobile Evolution www.sp-assurance.com As presented June 9, 2014

4. Mobile Ecosystem Framework www.sp-assurance.com As presented June 9, 2014

5. Mobile Portals Vs Native Applications www.sp-assurance.com As presented June 9, 2014

6. Agenda What is Mobile App Testing Why Test Mobile Apps How to Test Mobile Apps www.sp-assurance.com As presented June 9, 2014

7. What is Mobile App Testing QA Strategy & Planning Test Case Management Manual & Automated Testing Compatibility Testing Functional Testing Exploratory Testing Security Testing Performance Testing Memory & Leakage Testing Localization Testing Usability Testing www.sp-assurance.com As presented June 9, 2014

8. www.sp-assurance.com Do you Bother? As presented June 9, 2014

9. www.sp-assurance.com How to Conduct the Mobile App Testing? ManualAutomated Simulator Easy to Setup Access to wide range of simulated devices Not Realistic Slow/Time Intensive Increased Test Coverage Excellent Functional Testing Not Realistic Doesn’t Test User Experience On-Device Realistic Testing Expensive to Acquire/Maintain Device Library Increased Test Coverage Can Test Physical Devices Worldwide High Upfront Investment As presented June 9, 2014

10. www.sp-assurance.com iPhone/iOS: – The testing matrix is a bit simpler as there is only one device manufacturer - The challenge is still to make sure the iPhone applications work across iOS versions. – This challenge, along with Apple's strict limitation on UDIDs, has made testing a major hassle for developers Android: – Is more complex in terms of its testing matrix - Each new app - and each new app version – has to function as expected on multiple device models from various manufacturers. – Functionality on mobile devices with touch screens vs. physical keyboards. – Performance on various Android OS versions. Approach to QA – Challenges As presented June 9, 2014

11. www.sp-assurance.com Approach to QA Test Planning and Strategy Test Plan and Strategy – Devised custom mobile test strategy based upon the business requirements. – Based on the requirements of the mobile application, finalized the best applicable approach out of Full Automation, Partial Automation or manual testing to test the mobile application and also develop a suitable framework for the automation testing – Test strategy specifies the test approach and the best framework. Unit and Integration Testing; Functional and System Testing; Compatibility Testing; Network Connectivity Testing; Performance Testing; Security Testing; UI Specifications in Cross- mobile OS; Acceptance Testing. As presented June 9, 2014

12. www.sp-assurance.com Mobile Apps Manual & Automated Testing ApproachTypes of TestingManual TestingAutomation Testing DevicesEmulators Standard Testing Integration TestingNoYesNo System TestingYesNo Regression TestingYesNoYes Special Type of Testing To Address Specific Challenges Compatibility Testing YesNoYes GUI TestingYesNo Types Of Testing More Relevant for enterprise Mobile Applications Performance TestingYesNoYes Security TestingYesNoYes Synchronization Testing YesNo As presented June 9, 2014

13. www.sp-assurance.com Usability testing should happen as soon as the basic stable for the application is ready. This is also true in order to test whether the application UI is user-friendly or not, or whether some part/functionality of the application is easily discoverable or not. Also, usability studies should be done for the different types of devices, such as touch screen devices, since the user has different experience for the same application on these devices. Some Key Criteria Device specific UI guidelines Text entry Finger sized targets Well organized work flow Consistency Call handling Response times Usability Testing As presented June 9, 2014

14. www.sp-assurance.com Performance testing is key criteria for the application success on the market. It may happen that application testing is carried though wi- fi network under which application might perform well, but it also happens that application has the poor performance for the end-user who are accessing site through the mobile carries. Application must be tested with different devices + carries wise mix depending on the county and region. Some Key Criteria Network Battery Volume Rendering Performance Testing As presented June 9, 2014

15. www.sp-assurance.com Compatibility Testing assures that a given application works as intended with selected devices with different screen sizes, resolutions, and internal hardware (memory size, processor speed, and button/input differences).It defines the feasible compatibility combinations of devices and interfaces for a specific testing assignment, in concurrence with the customer’s requirement. OS Device Screen resolution Synchronization testing: This testing focuses on data exchange and synchronization among different mobile devices, PDAs, and PCs using infrared frequency and USB ports. Compatibility Testing As presented June 9, 2014

16. www.sp-assurance.com All the tests relevant to a thick client application can be applicable to mobile applications. Ø Authentication checks Ø Input Validation checks Ø Session Management checks Ø Encryption checks Ø Application checks Ø SQL injection checks Ø LDAP injection checks Ø XPATH injection checks Security Testing As presented June 9, 2014

17. www.sp-assurance.com Testing Process Ensure functionality of the site is stable – Test mobile applications on the desktop browser Test on device emulator to get the browser/platform coverage Test on the device itself to find the device specific bugs As presented June 9, 2014

18. www.sp-assurance.com Conclusion Scope Definition  Device/OS selection, keeping track of ever-changing trends  Requirements Compatibility Assessment Investment to build expertise in specific areas of expertise in Mobile space  Areas of Focus/Critical to Quality Areas  Tools and Technologies and Resources Comprehensive Test Strategy - judicious mix of manual & automated testing As presented June 9, 2014

19. www.sp-assurance.com Why Software Assurance 1. Near-Zero Ramp Up – SPA Testers have extensive knowledge and various Industry domain expertize. 2. Zero Cost to Clients for Devices, Tools/Emulators, Setup - SPA Mobile Lab has key devices, iMacs/PCs and will add new devices as required. SPA Mobile Lab has emulators installed to emulate one-off devices. Also, we monitor devices usage and proactively add real devices as usages increases. 3. Very Experienced Team: Testers have 4 – 10 years testing experience with manual, mobile testing with devices and tools, automation experience including exposure to DeviceAnyWhere One of the mobile solution we are testing is Confidential Mobile Apps (Android and iPhone) and Backend Server which is integrated with many III systems (coupon server, advertisement servers, Lottery Agency Servers, etc.) and deals with complex State lotteries Rules. Already launched for Texas & CA and adding all the states in US. As presented June 9, 2014

20. www.sp-assurance.com As presented June 9, 2014

21. www.sp-assurance.com Contact us for Mobile App Testing Strategy free one hour consultation ! Software Assurance, LLC 7708 Mapleridge Drive, Plano, Texas 75024, United States. Phone No: +1 972.992.4200 x103 E-Mail ID: SPASolutionTeam@sp-assurance.com As presented June 9, 2014