1. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Introduction to Mobile Performance Testing Wilson Mar, Angel Tran, Shlomi Salma HOL330 in Sands 305, June 13, 2013

2. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2 Mobile apps are now: Why performance test mobile apps? how customers locate stores and information how brands get exposure many times a day the “face” of the organization

3. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3 Slow app = Slow product?

4. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 4 Baseline vs. impact of network latency, etc. [P01] from HP Network Virtualization by Shunra

5. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 5 Possible points of risk in landscape Storage DB Servers App Servers Web Servers Load Balancers 3 rd Party Cloud Services CDNs & CoLo. Carriers Internet Browsers Platforms & Versions Firewalls VPNs Device Features 2G,3G,4G Cellular Mobile Components Screen Sizes Web Services LANs ISPs DB Indexes & Logs Resourc e Usage Latency & Loss Pooling & Threadin g Server Config. SysAdmin:DBA:Back-end:Dev:Network: Data Cachin g mDev: Encrypt, Compres s. Load Bal. Algorith m Network:

6. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 6 HP Live Network Collaborate 2 HP LoadRunner components and workflow Virtualize Network 5 End User Application Server(s) Internet/WAN Database Analyze, Compare, Report 8 Client(s) Generate Load 6 Author Scripts 1 Measure Impact 7 Test Scenario Plan and Execute Tests 3 Virtualize Services 4

7. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7 Scan for more information LoadRunnerNetwork Virtualization Service Virtualization Mobile Testing HP Codescan app http://www.hp.com/go/...

8. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8 Apple App Store Play. googl e.com iPhone, iPad Android “feature phones” Windows PC Mobile technology terms Safari browser URL m.ft.com mobile site ft.com/ws web services ft.com HTML5 responsive design Native app internet explorer ft.com HTML4 URL minima l browse r UR L Hybrid app Chrome browser

9. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Mobile LoadRunner Scripting Demos https://connections.houston.hp.com/docs/DOC-15086

10. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 10 http://code.google.com/p/android-screen-monitor/ Android Screen Monitor Download to folder …\sdk\platform-tools\ASM.jar Within Windows Explorer, double click on ASM.jar

11. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11 Create a New Script, Mobile Category HP LoadRunner VuGen 11.5 SP1+

12. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12 Multiple Approaches Available Browser or hybrid app: Ajax? > TruClient Ajax Mobile scripting protocol using User Agent spoofing in FirefoxTruClient Ajax Mobile Simple > Mobile HTTP/HTML scripting protocol Native app: > Mobile HTTP/HTML scripting protocol Android: No device > Record Emulator using Android Virtual Device (AVD)Record Emulator Have rooted device > Mobile Recorder generate lrpcap to AnalyzeMobile Recorder iOS & others: > LoadRunner Proxy on same subnet/Wi-Fi hub (the newest technique)LoadRunner Proxy > Record & Analyze WinPcap capture on the mobile app serverRecord & Analyze

13. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13 Recording Method TruClient Ajax TruClient Ajax HP LoadRunner VuGen 11.51+ App web server User Agent in Firefox >

14. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14 TruClient recording HP LoadRunner VuGen 11.51+

15. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15 Devices with User Agent strings Count: 27 HP LoadRunner VuGen11.52

16. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16 Sample User Agent for Samsung Galaxy S3 User Agent string example Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; GT- I9300 Build/IMM76D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 HP LoadRunner VuGen11.52 More at http://www.useragentstring.com/http://www.useragentstring.com/

17. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 17 Android Versions 4.1 (16) 4.2 (17) 2.3 (9,10) 4.0 (15)

18. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18 Mobile Device Manager Tool in VuGen

19. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 19 VuGen Scripting Process from HP Virtual User Generator User Guide 11.52 page 73 1.Configure recording settings 2.Consider run-time settings 3.Object identification using script levels 4.Specify Transaction Names 5.Specify Completion End Events Logic 6.Insert flow control 7.Run-time logic 8.Vary data based on parameters 9.Using C script functions in a library

20. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 20 Random Think-time in TruClient Arguments: http://www.perftesting.co.uk/ajax-truclient-tips-and-tricks-part-ii/2012/05/02/ Math.floor( 11 * Math.random()+5 );

21. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 21 TruClient Toolbox drag and drop window.alert( “randWait=” + randWait ); Arguments: http://www.perftesting.co.uk/ajax-truclient-tips-and-tricks-part-ii/2012/05/02/ Math.floor( 11 * Math.random()+5 ); var randWait =

22. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HTTP/HTML Mobile Recording https://connections.houston.hp.com/docs/DOC-15086

23. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 23 Mobile HTTP vs. HTML HP LoadRunner VuGen mode=“HTML”mode=“HTTP” Parse HTML to automatically identify additional resources to download For use with web services calls. Does not parse for resource requests. CSS JavaScript

24. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 24 Record Mobile HTTP/HTML HP LoadRunner VuGen11.52

25. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 25 HTTP/HTML TruClient HTTP/HTML Recording Methods Wizard Proxy Recordin g Record Emulator Analyze Traffic Record & Analyze Traffic HP LoadRunner VuGen11.52

26. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Proxy Recording https://connections.houston.hp.com/docs/DOC-15086

27. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 27 HTTP/HTML TruClient HTTP/HTML Recording Methods Wizard Proxy Recordin g HP LoadRunner VuGen11.52

28. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 28 Proxy Recording Android LoadRunner Proxy HTTP/HTML Proxy Recordin g HP LoadRunner VuGen11.5x App web server Port 80/443 VuGen Proxy IP: Port 8080 AP K iOS IPA

29. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 29 Same subnet via Wi-Fi router HTTP/HTML Demo web service VuGen Proxy Ethernet cables Wi-Fi router on private LAN Proxy Recordin g

30. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 30 Proxy Recording HP LoadRunner VuGen11.52 HTTP/HTML Proxy Recordin g

31. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 31 Proxy Recording Setup on iOS 1. Source: http://www.amsys.co.uk/2012/blog/how-to-setup-proxy-servers-in-ios/ 4.3. Scroll down2. Eleanor Password: ncjm-q3ey-t1dd Eleanor 192.168.1.2 255.255.255.0 192.168.1.1 192.168.1.3 8080

32. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 32 Proxy Recording Setup on Android Galaxy S3 (4.1.2) 1.4.3.2. Long press Eleanor ncjm-q3ey-t1dd

33. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Record Emulator https://connections.houston.hp.com/docs/DOC-15086

34. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 34 HTTP/HTML HTTP/HTML Recording Methods Wizard Record Emulator HP LoadRunner VuGen11.52

35. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 35 Record Emulator Android Recording Method Android device emulator HTTP/HTML Record Emulator AP K HP LoadRunner VuGen11.5x App web server Async. AP K @device ADT file Android… \sdk\tools File manager Backup Play. Google.com Install Copy

36. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 36 Record Emulator Requirements 1.USB cable to device 2.USB driver for device 3.Android app APK file for Android app under test 4.Android file download manager app to extract APK file from device 5.JDK (Java Development Kit) 6.ADT (Android Development Toolkit) plug-in for Eclipse 7.AVD (Android Virtual Device) within Eclipse for device under test 8.JAVA_HOME and PATH Windows environment variables 9.HP LoadRunner 11.50 and SP2 patch to upgrade to 11.52 HTTP/HTML Record Emulator

37. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 37 Emulator

38. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Record & Analyze Traffic https://connections.houston.hp.com/docs/DOC-15086

39. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 39 HTTP/HTML HTTP/HTML Recording Methods Wizard Record & Analyze Traffic HP LoadRunner VuGen11.52

40. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 40 Record & Analyze Traffic Android network sniffer iOS HTTP/HTML Record & Analyze Traffic Ad hoc network.cap,.pcap HP LoadRunner VuGen11.5x App web server AP K IPA

41. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Analyze Traffic https://connections.houston.hp.com/docs/DOC-15086

42. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 42 HTTP/HTML HTTP/HTML Recording Methods Wizard Analyze Traffic HP LoadRunner VuGen11.52

43. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 43 Analyze Traffic Mobile Recorder Android.lrpcap HTTP/HTML Analyze Traffic Android 4.1+ (rooted) App web server HP LoadRunner VuGen11.52 AP K

44. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 44 Android Mobile Recorder 1. Start Recording3. Stop and send email2. Perform user steps.

45. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 45 Android Mobile Recorder Settings

46. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 46 Recording Methods Recap Mobile Recorder Android.lrpcap LoadRunner Proxy device emulator network sniffer iOS VuGen Proxy IP: Port 8080 HTTP/HTML Proxy Recordin g Record Emulator Analyze Traffic Record & Analyze Traffic Port 80/443 User Agent in Firefox > Android 4.1+ (rooted) Ad hoc network AP K.cap,.pcap TruClient Ajax HP LoadRunner VuGen11.52 App web server @device ADT file IPA Play. Google.com

47. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Mobile scenarios https://connections.houston.hp.com/docs/DOC-15086

48. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 48 How can we help? Run test cases Provision & deploy environment Execute automated build Application Security Assessment Test results Security Code Scan Fortify Source Code Analysis UFT / BPT LoadRunner WebInspect Continuous Delivery Automation (CDA) (Jenkins) HP integrated testing suite ALM Analysis Executive Scorecard Performance Center Service Virtualization Network Virtualization Development Agile Manager Business Service Management Monitoring & Diagnostics Analytics App. Lifecycle Intelligence ALM Lab Management Tear down environment Continuous Delivery Automation (CDA)

49. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 49 Shopping process Interconnected component services Pay Buy Ship Track Product Search Customer profiles Payment Shipping Composite Managed cloud Public cloud Traditiona l Track package Private cloud

50. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 50 Concurrency and rendezvous [P10] Illustrative data

51. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 51 Key take-aways For mobile browser apps (jQuery Mobile, Sencha, PhoneGap, etc.), little scripting is needed using User Agent spoofing via Firefox TruClient Mobile JavaScript executes against a DOM for each virtual user Traffic captured between native apps and server are converted to VuGen scripts Android native app traffic on rooted devices can be recorded on device using LoadRunner Mobile Recorder iPhone and iPad (iOS) -- all non-rooted apps – can be recorded using LoadRunner Proxy Monitor and Diagnose using HP Business Service Management Consider HP Network Virtualization and Services Virtualization

52. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 52 For more information Attend these sessions Mobile Performance Hands-on Lab HOL3330 Sands Room 305 Tuesday 1p – 3p Thursday 3p-5p After the event Contact your sales rep Visit: http://www.hp.com/go/mobiletestin g http://www.hp.com/go/loadrunner http://www.hp.com/go/mobiletestin g http://www.hp.com/go/loadrunner Your feedback is important to us. Please take a few minutes to complete the session survey. Visit these demos Applications: mobile performance testing RT3112 Wednesday June 12, 1030 am Lido 3101A Thursday June 13, 930 am Lido 3101B

53. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Thank you