1. Mark Walton CzechTest 2013 «Virtual Test Environment» 1 (43) Slide 1 (300) Whats the biggest obstacle in real-life software testing? Mark Walton CzechTest 2013 «Virtual Test Environment»

2. Mark Walton CzechTest 2013 «Virtual Test Environment» 2 (43) Slide 2 (300) Test design? Test management? Test automation? Traceability? Well?

3. Mark Walton CzechTest 2013 «Virtual Test Environment» 3 (43) Slide 3 (300) … its TEST ENVIRONMENT!

4. Mark Walton CzechTest 2013 «Virtual Test Environment» 4 (43) Slide 4 (300) The Solution? Test environment virtualization Mark, tester in: Telecomm Banking Insurance Contact: markwalton202@gmail.com

5. Mark Walton CzechTest 2013 «Virtual Test Environment» 5 (43) Slide 5 (300) Common test environment problems How does test environment virtualization work? Business benefits Vendors

6. Mark Walton CzechTest 2013 «Virtual Test Environment» 6 (43) Slide 6 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

7. Mark Walton CzechTest 2013 «Virtual Test Environment» 7 (43) Slide 7 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

8. Mark Walton CzechTest 2013 «Virtual Test Environment» 8 (43) Slide 8 (300) 1. Huge Cost (A) Because you need special stuff: – Expensive server – Separate network – Telephone exchange – A Maserati in southern Mediterranean – Huge amount of data – A something that does not exist yet

9. Mark Walton CzechTest 2013 «Virtual Test Environment» 9 (43) Slide 9 (300) 1. Huge Cost (B) Because you need special tools: – Air-conditioned test laboratory – Hardware tools to be able to see: In-Circuit Emulator Logic Analyser Oscilloscope Listening instruments – Burglary-proof test laboratory

10. Mark Walton CzechTest 2013 «Virtual Test Environment» 10 (43) Slide 10 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

11. Mark Walton CzechTest 2013 «Virtual Test Environment» 11 (43) Slide 11 (300) 2. Dispersed Responsibility Who takes back-ups? Who installs and configures software and data? Who gives you access rights? Who are your system administrators prime customers? Who has access priority?

12. Mark Walton CzechTest 2013 «Virtual Test Environment» 12 (43) Slide 12 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

13. Mark Walton CzechTest 2013 «Virtual Test Environment» 13 (43) Slide 13 (300) 3. Maintenance Administration and order-keeping Between test passes During project After the project And do not forget corrective maintenance!

14. Mark Walton CzechTest 2013 «Virtual Test Environment» 14 (43) Slide 14 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

15. Mark Walton CzechTest 2013 «Virtual Test Environment» 15 (43) Slide 15 (300) 4. Many Environments Developers own environment Subsystem test environment Integration environment System test environment Performance test environment Pre-production environment Final production environment

16. Mark Walton CzechTest 2013 «Virtual Test Environment» 16 (43) Slide 16 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

17. Mark Walton CzechTest 2013 «Virtual Test Environment» 17 (43) Slide 17 (300) 5. Access Difficulties Many things are hidden in real systems Expensive hardware tools may be required Testing versus debugging purposes Remote access Access booking - conflicts

18. Mark Walton CzechTest 2013 «Virtual Test Environment» 18 (43) Slide 18 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

19. Mark Walton CzechTest 2013 «Virtual Test Environment» 19 (43) Slide 19 (300) 6. Simulation Costs Building and debugging simulators Simulator maintenance and support Sub-system A Sub-system B simulator Test A Sub-system A Sub-system B Joint test Sub-system B Sub-system A simulator Test B

20. Mark Walton CzechTest 2013 «Virtual Test Environment» 20 (43) Slide 20 (300) Typical Environment Problems: 1.Huge cost 2.Dispersed responsibility 3.Maintenance 4.Double or even triple environments 5.Access difficulties 6.Simulation 7.Special: SOA, cloud and Web-services

21. Mark Walton CzechTest 2013 «Virtual Test Environment» 21 (43) Slide 21 (300) What is a «cloud»? This is «cloud»! Application on server… … used by (relatively) thin clients… … through Internet

22. Mark Walton CzechTest 2013 «Virtual Test Environment» 22 (43) Slide 22 (300) Application on server provides relatively small functions, called «services»… … used by (relatively) thin clients… … through Internet, using so-called SOAP messages «Web services»? SOA? These are «Web services»

23. Mark Walton CzechTest 2013 «Virtual Test Environment» 23 (43) Slide 23 (300) Web-services use SOA, … or, are an example of SOA (Service Oriented Architecture) SOAP WSDL

24. Mark Walton CzechTest 2013 «Virtual Test Environment» 24 (43) Slide 24 (300) 7. SOA, Cloud and Web-services Test environment: – For the development of a cloud application, simulating many clients with different user profiles – For the development of client applications, simulating one or many cloud applications (SOA services)

25. Mark Walton CzechTest 2013 «Virtual Test Environment» 25 (43) Slide 25 (300) Common test environment problems How does test environment virtualization work? Business benefits Vendors

26. Mark Walton CzechTest 2013 «Virtual Test Environment» 26 (43) Slide 26 (300) Half-way Summary 1 Traditional test environment:

27. Mark Walton CzechTest 2013 «Virtual Test Environment» 27 (43) Slide 27 (300) Half-way Summary 2 Virtual test environment:

28. Mark Walton CzechTest 2013 «Virtual Test Environment» 28 (43) Slide 28 (300) Virtual Test Environment You could build it all by yourself, of course, … but it is better to acquire a pret-a- porter framework, a tool Not all functionality need to be virtualized, but only the interesting part of its behaviour Hence the name ABV (application behaviour virtualization)

29. Mark Walton CzechTest 2013 «Virtual Test Environment» 29 (43) Slide 29 (300) How Is ABV Created? 1.Either through recording (capturing) of the behaviour of the real system (installing the virtualizer as a proxy server) 2.Or from interface specifications (perhaps in WSDL) 3.Or from old transaction logs

30. Mark Walton CzechTest 2013 «Virtual Test Environment» 30 (43) Slide 30 (300) ABV Configuration Various behaviours for different projects, versions or customers Incorrect behaviour simulated to test failure scenarios ABV can be delivered locally or globally Or even through SOA for commercial purposes

31. Mark Walton CzechTest 2013 «Virtual Test Environment» 31 (43) Slide 31 (300) Common test environment problems How does test environment virtualization work? Business benefits Vendors

32. Mark Walton CzechTest 2013 «Virtual Test Environment» 32 (43) Slide 32 (300) Mitigates the Problems 1(2) Missing or unstable components Unavailable physical test environments; Inaccessible or costly third-party systems; Very expensive, complex or secret parts of systems, not to be used in testing (mainframe, financial, ERP); Many users of test environment resources (access and configuration hard)

33. Mark Walton CzechTest 2013 «Virtual Test Environment» 33 (43) Slide 33 (300) Mitigates the Problems 2(2) Using agile methods, when a large system is developed by a number of separate agile teams, each in need of own test environment; A great number of systems, with which the SUT must be integrated; The need to access test environment from various locations in a distributed project

34. Mark Walton CzechTest 2013 «Virtual Test Environment» 34 (43) Slide 34 (300) But, Keep This in Mind: There exists an army of IT people used to the current state of affairs, and even proud of their ability to cope with chaos, fear and trembling, sweat, blood and tears! Professor Martin Tornquist, founder and head of T&M Testes de Software (www.tmtestes.com.br), says: It is easier to convince CFO than CIO to invest and improve testing and requirements management, because CFO notices the cost of poor quality, while CIO parasitizes on it.

35. Mark Walton CzechTest 2013 «Virtual Test Environment» 35 (43) Slide 35 (300) And Read This professionaltester. com/files/PT- issue18.pdf

36. Mark Walton CzechTest 2013 «Virtual Test Environment» 36 (43) Slide 36 (300) Common test environment problems How does test environment virtualization work? Business benefits Vendors

37. Mark Walton CzechTest 2013 «Virtual Test Environment» 37 (43) Slide 37 (300) Parasoft parasoft.com/jsp/products/virtualize _splash.jsp Utilities

38. Mark Walton CzechTest 2013 «Virtual Test Environment» 38 (43) Slide 38 (300) CA technologies CA LISA® www.ca.com/us/virtual.aspx itko.com/solutions/index.jsp www.ca.com/us/content/Integration /itko.aspx

39. Mark Walton CzechTest 2013 «Virtual Test Environment» 39 (43) Slide 39 (300) IBM - GreenHat servicevirtualization.com/gr oup/greenhat http://www- 01.ibm.com/software/ratio nal/servicevirtualization/sol utions/ testmagazine.co.uk/2011/0 9/suiting-customer-needs/

40. Mark Walton CzechTest 2013 «Virtual Test Environment» 40 (43) Slide 40 (300) Hewlett-Packard http://www.hp.com/sbso/serverstor age/article/virtualization-oct.html http://h18004.www1.hp.com/produ cts/servers/vmware/index.html?psn =servers

41. Mark Walton CzechTest 2013 «Virtual Test Environment» 41 (43) Slide 41 (300) Grid Tools http://www.grid- tools.com/products/intelligent_virtu al_services.php

42. Mark Walton CzechTest 2013 «Virtual Test Environment» 42 (43) Slide 42 (300) Learn More en.wikipedia.org/wiki/Service_virtual ization#References Note: Virtualization is not only for Web-services testing (but much of it is) Test environment virtualization need not be available in cloud (but often is) Virtualization Tool ǂ Virtual Test Environment until configured and programmed!

43. Mark Walton CzechTest 2013 «Virtual Test Environment» 43 (43) Slide 43 (300) The biggest obstacle – no longer! Mark Walton CzechTest 2013 «Virtual Test Environment»