1. Copyright © Panaya Oracle ® E-Business Suite Testing: How to Get Your Business Users On-Board Amir Farhi Director, Product Marketing

2. Copyright © Panaya Agenda 2 The challenges IT faces when testing Oracle EBS changes Improving cooperation by business users in the testing process SaaS accelerated manual testing technology

3. Copyright © Panaya Panaya at a Glance Leader in Oracle EBS & SAP SaaS-based Testing and Impact Analysis Automation software Serving customers in 60+ countries 1,000+ enterprise customers, 2,000+ successful ERP projects 3,000+ ERP systems analyzed 500,000+ test cases in past year 3

4. Copyright © Panaya Constant Need for Change 4 Chart of Account Changes Functional Enhancements Mergers & Acquisitions New Business Processes Regulations Upgrades Patches System Consolidation Infrastructure Changes Migrations Business-Driven IT-Driven

5. Copyright © Panaya Panaya Quality Management Cloud Change Impact Simulation Oracle R12 upgrades, point-release upgrades Oracle patches Chart-of-Account (CoA) changes Custom-code releases Code Remediation Collaborative Test Management & Test Acceleration Automated test script creation Automated documentation and test evidence Accelerated manual testing ALM integration (HPQC, Oracle ATS) “Cloud Wisdom” – transforming common practices to best practices 5 Scope & Accelerate changes in Enterprise Applications, Cutting Cost & Risk

6. Copyright © Panaya Panaya on Oracle.com http://www.oracle.com/us/products/applications/ebusiness/ebs-upgrade/index.html#cost 6

7. Copyright © Panaya Business Users IT Group Initiate: Plan: Build: Test: Business RequirementIT Requirement Prepare Spec & Scope Develop IT Manual Testing Automatic Testing Off-Shore Testing Limited knowledge of real-life business processes… Which constantly change! Please test The Change Process, Today 7

8. Copyright © Panaya The Constraints of Change, Today 8 Sponsor Methodologies Compliance

9. Copyright © Panaya 9

10. Manual & Automated Testing 10 Regression testing of static, critical business processes Unattended execution (“lights-out”) Developed by test engineers Unit testing, functional testing, user acceptance testing, regression testing Performed by functional experts & business key users Performed by HP QTP, OATS, … Automated Testing Manual Testing

11. Copyright © Panaya Panaya Manages & Accelerates Manual Testing 11 Accelerated Manual Testing Regression testing of static, critical business processes Unattended execution (“lights-out”) Developed by test engineers Managed & Accelerated by Panaya Performed by HP QTP, OATS, … Automated Testing Unit testing, functional testing, user acceptance testing, regression testing Performed by functional experts & business key users

12. Copyright © Panaya Competing Forces of Testing 12 Quality & Risk Cost Time to Market Redundant testing Creating & maintaining test scenarios Executing & documenting manual tests Testing cycles take too long Capturing business process knowhow Lack of collaboration with the business for test execution Lack of collaboration with the business for test execution Scoping what to test based on risk Capturing test evidence for auditing Eliminating critical production issues Test process governance

13. Copyright © Panaya ERP Manual Testing Challenges Source: Panaya ERP survey Capturing business process knowledge Maintaining Test Documentation Creating Test Documentation Test Execution Scoping & prioritizing the test plan Test project management Passing Audits 52% 43% 41% 38% 20% 6% 13

14. Copyright © Panaya Customers’ Testing Methodologies 20% Ad-Hoc 50% Organized 30% Scripted 14

15. Copyright © Panaya Testing Methodologies Characteristics Oracle EBS system is stable, minimal changes Use email to communicate testing tasks No test catalog (no test scenarios) Test runs need not be documented No test automation Ad-hoc 15

16. Copyright © Panaya How Panaya Addresses Your Testing Needs Visibility into testing progress Visibility into business process testing coverage Improved test run documentation Improved defect management Specific implementation methodology: onboarding & ongoing Ad-hoc 16

17. Copyright © Panaya Excel to manage & track testing process Rely on Business Process owners knowledge (SME) to execute the test Test scenarios documented up to the transaction level in Word/Excel Low use of test automation Testing Methodologies Characteristics Organized 17

18. Copyright © Panaya Easily manage, assign, and track testing activities Automate test evidence documentation Manage defects Building block for regression test suite Specific implementation methodology: onboarding & ongoing How Panaya Addresses Your Testing Needs Organized 18

19. Copyright © Panaya Excel to manage & track testing process Tests executed by non-SME (QA Team, Offshore or System Integrator) Test scenarios documented to the screen/field level in Word/Excel Likely to use test automation Testing Methodologies Characteristics Scripted 19

20. Copyright © Panaya Easily manage, assign, and track testing activities Accelerate test scenario creation, test execution, defect reporting, and test evidence documentation Manage defects Building block for regression test suite Specific implementation methodology: onboarding & ongoing How Panaya Addresses Your Testing Needs Scripted 20

21. Copyright © Panaya Panaya Collaborate Testing - Demo 21

22. Copyright © Panaya Test Planning: Assign User 22

23. Copyright © Panaya Recording Test Scenarios 23 Click to start recording your test scenario

24. Copyright © Panaya Follow Your Business Process 24

25. Copyright © Panaya Panaya Automatically Generates a Test Script 25

26. Copyright © Panaya Add manual steps or external systems Add comments and special instructions Attach documents (e.g. test variations, test data) Append more business functions Tailor Test Script Details 26

27. Copyright © Panaya Easily Export to Microsoft ® Word or Excel 27

28. Copyright © Panaya Manage Test Catalog 28

29. Copyright © Panaya Manage Test Catalog Details 29

30. Copyright © Panaya 2.Panaya code analysis automatically identifies which functional tests are covering those unit tests 3. Adjust testing scope -risk of failure (for upgrade or patching) -business usage 1.Panaya impact analysis identifies required unit tests for project Integrated Test Coverage Assessment (via automated impact analysis simulation) 30

31. Copyright © Panaya 1.Panaya impact analysis identifies project code corrections impacting each functional scenario 2.Panaya marks functional scenario as “not ready to test” due to pending project code corrections. When code corrections completed, status changes to “ready to test”, and tester is notified. Integrated Test Coverage Assessment (via automated impact analysis simulation) 31

32. Copyright © Panaya Open test task Assign test run to user Select scenario Accelerated Functional Test Execution 32

33. Copyright © Panaya Tester’s task list Record Oracle session Initiate test evidence recorder Automated Test Evidence Recording 33

34. Copyright © Panaya Report test failure & Create defect Assign and manage defect Re-test and record evidence View test evidence Functional Test Execution Manage defects & re-test 34

35. Copyright © Panaya Assign Adhoc Test Tester’s task list Record Oracle session Initiate test evidence recorder Functional Test Execution Adhoc/Instant Testing 35

36. Copyright © Panaya Monitor Test Progress 36

37. Copyright © Panaya Panaya myTest Browserless Desktop Web Application Tasks are fed to Business User desktops Testers don’t need to go to ALM or Panaya portal 37

38. Copyright © Panaya Running a Scripted Test IT or Business User is assigned a task from ALM User selects Manual Run & Document Original Script is presented User completes testing (Panaya will sync with ALM) 38

39. Copyright © Panaya Panaya also works with other ALMs (HP Quality Center or Oracle ATS) Use Panaya Test Builder to build your functional test scripts automatically creates HP/OATS test designs, with step-by-step details HPQC/OATS manages test results and defect management 39

40. Copyright © Panaya Key Takeaways Even with Test Automation, Manual Testing still dominates  Accelerate the process! You rely on your users to help with the testing  Make it easy for them! SaaS is easy to start; easy to deploy and easy to manage  Test drive Panaya’s Collaborative Manual Testing! 40

41. Copyright © Panaya info@panaya.com Tha k you! 41