1. Test Automation An Approach to Automated Software Regression Testing Presented by Adnet, Inc Feb 2015

2. Introduction Automates manual repeatable test processes using formal testing procedure Automates manual repeatable test processes using formal testing procedure Controls test execution, comparison of actual outcomes to predicted outcome with test preconditions Controls test execution, comparison of actual outcomes to predicted outcome with test preconditions Saves time and deduces cost by automating repeated manual testing Saves time and deduces cost by automating repeated manual testing Why Test Automation Repeated manual test prone to human errors (overlooking) Repeated manual test prone to human errors (overlooking) Learning cost of new test teams or new members Learning cost of new test teams or new members Regression test cycles are increasing with distributed development Regression test cycles are increasing with distributed development Wider acceptance of Agile model (needs frequent and more tests) Wider acceptance of Agile model (needs frequent and more tests) Manual test data setup with multiple data-sets increases complexity Manual test data setup with multiple data-sets increases complexity 2 Test Automation – Introduction

3. Scope and Approach (each software, not enterprise) Scope and Approach (each software, not enterprise) What to Automate (often repeatable tests- regression tests) What to Automate (often repeatable tests- regression tests) Smoke Tests (undocumented exploratory tests) Smoke Tests (undocumented exploratory tests) Individual often repeated test cases Individual often repeated test cases More useful for key business function where accuracy required More useful for key business function where accuracy required Easy accommodates variation in test datasets Easy accommodates variation in test datasets What not to automate What not to automate Stress and Load Test Stress and Load Test Need different tools Need different tools Different Strategy Different Strategy 3 Test Automation – Scope and Approach

4. 4 4 Reduce Cost Reduce Cost Reduce time in testing Reduce time in testing Reduce cost from automation Reduce cost from automation ROI: Gain time in new function test ROI: Gain time in new function test Reduce investment by using Freeware Tools rather than Vendor based (Options) Reduce investment by using Freeware Tools rather than Vendor based (Options) Automation strategy Automation strategy Incrementally add more of the new functions for the next cycle of regression testing Incrementally add more of the new functions for the next cycle of regression testing First automate smoke tests and then individual test cases First automate smoke tests and then individual test cases Baseline scripts and reuse each time. Baseline scripts and reuse each time. Develop a library for commonly used routines like login for reuse. Develop a library for commonly used routines like login for reuse. Test Automation Strategy

5. 5

6. 6 Record-Playback Record-Playback Record once playback each time. Record once playback each time. Data-driven testing Data-driven testing One script runs with multiple sets of data. One script runs with multiple sets of data. Modularity-driven testing Modularity-driven testing Common libraries for common functions like.. Common libraries for common functions like.. Login() Login() Check_VA_Enroll() Check_VA_Enroll() Check VA Eligibility() Check VA Eligibility() Exit() Exit() Keyword-driven testing Keyword-driven testing Keywords can make up a script.. Keywords can make up a script.. Initialization():Launch browser and login Initialization():Launch browser and login Test1() :Test for a Requirement Test1() :Test for a Requirement Test2() :Test for GUI like labels, links Test2() :Test for GUI like labels, links Exit() :Exit from the browser Exit() :Exit from the browser Type of Frameworks

7. 7 7 Test Automation Framework HP ALM Test Resources Module HP ALM Test Plan /Lab Module Configuration Files Test Data Files Object Repository Generic Functions library Business Process Library Documentation Folders by Release Automated Tests (QTP) Test Set TestRunZ TestRun Test Machine / HEC App Database client / drivers Run Scripts Results Detailed logs Test Execution initiated from Lab Results get uploaded back to Test Lab Any supporting docs / user guides for the project Scripts are organized into folder named after releases Database drivers required in order query the database Application runs in a browser Results, logs and screenshots are stored locally for easy access Screenshots

8. 8 Results Generated After Execution A snapshot of test result file in excel format. For Illustration Only A detailed log file will also be created. Screenshots stored locally as well as in ALM.

9. 9 Manual vs Automated Test Efforts

10. 10 Cumulative Savings

11. 11 Automated results generated in Excel or HTML- not dependence on the test software and format easy to analyze Automated results generated in Excel or HTML- not dependence on the test software and format easy to analyze Manual tester released for new and on key features. Manual tester released for new and on key features. Automating regression test allow frequent small changes requests. Automating regression test allow frequent small changes requests. Automation framework provides flexibility to change existing SQL queries (for test data pull). Automation framework provides flexibility to change existing SQL queries (for test data pull). Easy to customize test data case for changes in test scenario Easy to customize test data case for changes in test scenario Huge savings in manual effort Huge savings in manual effort Screenshots captured traced sources of errors and easy to debug software Screenshots captured traced sources of errors and easy to debug software Benefits of Automation

12. 12 Challenges for Automation Higher initial cost Higher initial cost Higher skill set needed Higher skill set needed More initial investment in infrastructure set-up More initial investment in infrastructure set-up Availability of test data could be limited Availability of test data could be limited Inconsistent application behavior Inconsistent application behavior Application response times Application response times

13. 13 Tools Type of Tools Type of Tools Commercial Tools: Commercial Tools: Support and maintenance advantage Support and maintenance advantage High cost High cost Freeware: Freeware: No support and depending on support groups No support and depending on support groups More labor intensive-higher implementation cost More labor intensive-higher implementation cost Adnet-HEC In-house Expertise in Adnet-HEC In-house Expertise in QTP QTP Rational Functional Tester Rational Functional Tester Test complete Test complete Selenium Selenium

14. 14 Contact Information Shri Sinha President Adnet, Inc. Shrisinha@Adnetcmm.com 703-598-4485