Presentation is loading. Please wait.

Presentation is loading. Please wait.

Launch & Grow Your Test Automation. Complex application Client/Server Financial sector – trading platform Very agile development QA Manually tested Off.

Similar presentations


Presentation on theme: "Launch & Grow Your Test Automation. Complex application Client/Server Financial sector – trading platform Very agile development QA Manually tested Off."— Presentation transcript:

1 Launch & Grow Your Test Automation

2 Complex application Client/Server Financial sector – trading platform Very agile development QA Manually tested Off the shelf automation Neovest

3 Project Realities Limited time to devote to development Little experience in automation Limited budget and no testing engineers were available to work on the project Automation needed to maintain quality Feature set growing Content scope was expanding Software release on aggressive schedule

4 People, Skills, Investment If we had a larger budget, we could hire more people If we had more people or budget, we could quickly increase our skill sets If we had a more mature skill set, we could save money Time – major project killer

5 Our Solution Controlling our budget Open source tools Proprietary development Tackling our time and people constraints Choosing our tool sets

6 Launch Goal Proof of Concept Test Prototype Ever Increasing Capabilities

7 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

8 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

9 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

10 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

11 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

12 Automation Evolution Record and PlaybackRecord and Playback Procedural ProgrammingProcedural Programming Common LibrariesCommon Libraries FrameworkFramework AnalysisAnalysis

13 Record and Playback Good Quick development of tests, quick to learn, immediate results Proof of concept rock star – fastest tool

14 Record and Playback Bad Very susceptible to user interface changes No easy result comparison mechanism Ugly Hard to maintain

15 Our Experience (Work in Progress) No tests User interaction log Robo error reports Record and Playback

16 Good Controlling the sprawl of monolithic code Reusable, maintainable, extensible Bad Susceptible to application changes Basic reporting Limited control for running tests Procedural Programming

17 Our Experience Basic Result Reports o Readable, easily accessed o Notification of test results o Excel is fast, already built, easy to import values Best Diabolical Innovation Great for prototypes Procedural Programming

18 Prototypes and Beyond Basic Rule of Software Prototypes Simple Compelling Metrics

19 Common Libraries Proliferation of procedures Solid program design was needed to improve efficiency

20 Forward Thinking Required in Program Design Dragon’s Horde Sloppy program design spreads quickly Control Board Common Libraries

21

22 Good Structure and organization Increases efficiency and capabilities Extends flexibility Reduces development time Bad Requires coordinating group Vulnerable to poor planning Common Libraries

23 Our Experience Pattern Matcher Simple Optical Character Reader Reporting Upgrade Common Libraries

24 Our Experience Controlling the most dynamic elements  ‘If’ statements based on version  Object mapping Version based mouse mapping table Loose Integration with application Tight integration with application Common Libraries

25

26 Our Experience Controlling the most dynamic elements  ‘If’ statements based on version  Object mapping Version based mouse mapping table Loose Integration with application Tight integration with application Common Libraries

27 Frameworks Good Flexible enough to handle a wide of variety tests Extensible enough to accommodate future changes Once created – faster development, keeping common code changes to a minimum

28 Bad More complex programming task Changes are made by a few architects Requires careful design and planning Frameworks

29 Our Experience Slingshot Load tests as suites Schedule and stop tests Direct ed reports Frameworks

30 Frameworks Our Experience Shotgun Load balancing Stop selected tests for replacement or reschedule Partitioning of environments

31 Analysis Analysis = Brains Determine cause Many tests means much analysis

32 Our Experience Test failure patterns Database test data points Performance Analysis Track common events Identify Trends Quantify “slowness” Analysis

33 Our Automation Development Plan Today Typical release cycle Test 29,000 data points in 120 tests Typical Development 3-5 day development cycle for standard tests

34 Your Experience Extensible, Flexible Rapid Development Minimal Maintenance Cheating Evolution

35 QUESTIONS? QUESTIONS?

36 Copyright © 2012 JPMorgan Chase & Co. All rights reserved The views expressed herein do not necessarily represent the views and opinions of JPMorgan Chase & Co. This material is provided for information only and is not intended as a recommendation or an offer or solicitation for the purchase or sale of any security or other financial instrument. In no event shall JP Morgan be liable for any use by any party of, for any decision made or action taken by any party in reliance upon, or for any inaccuracies or errors in, or omissions from, the information contained herein and such information may not be relied upon by you in evaluating the merits of participating in any transaction. JPMorgan and its affiliates may have positions (long or short), effect transactions or make markets in securities or financial instruments mentioned herein, or provide advice or loans to, or participate in the underwriting or restructuring of the obligations of, issuers mentioned herein. Nothing in these materials constitutes a commitment by JP Morgan or any of its affiliates to enter into any transaction. Clients should contact their salesperson at, and execute transactions through, a JP Morgan entity qualified in their home jurisdiction unless governing law permits otherwise. JP Morgan is the marketing name for the investment banking activities of JP Morgan Chase & Co. and its subsidiaries and affiliates worldwide. J.P. Morgan Securities LLC. is a member of FINRA, NYSE and SIPC.


Download ppt "Launch & Grow Your Test Automation. Complex application Client/Server Financial sector – trading platform Very agile development QA Manually tested Off."

Similar presentations


Ads by Google