1. Platinu m Sponsor s Silver Sponsors Gold Sponsor s

2. Conference Mobile App dodn14.azurewebsites.net Quick access to conference info Build your custom agenda Anonymously rate the sessions you attended Share with the Twitter-verse

3. Fun Stuff Downstairs

5. Agenda Cloud load testing

6. Load testing How will the application behave in front of the expected users load? Performance testing How fast will the application code perform? Stress testing What is point of users-load that will break your application? Capacity planning Will the application be able to scale up to the expected future capacity? Why Load Testing?

7. Target Server Agent Visual Studio Ultimate Test Controller Target Server Collector Agent Agent Collect ASP.NET profiler traces Unlimited Load Test Virtual Users

9. Install your controllers/agents Physically setup computers Replicate this to all the computers Buy appropriate computers Net load testing can be: What is needed to make that work?  Expensive to setup  Provisioning is complex  Slow to scale  Costly to maintain

11. Announcing: Easier Load Testing Quickly define and configure simple load tests Use the elastic scale of VSO to simulate hundreds or thousands of virtual users Measure the underlying system using Application Insights

12. Announcing: Easier Load Testing

13. Architecture Visual Studio Load Test Web Service Test Agent Pool - Dynamic Results database Worker Azure Blobs Azure Tables

14. What do you load test? Websites Web Services Databases NOT the User Interface

17. Get infrastructure in cloud when you need it. No need to setup your own infrastructure and maintain it. Use the same load test project which you use for on premises today. Scale out easily in case of doing stress testing. Benefits of cloud load testing

20. Run Performance Report Load Test Analysis Built into Excel for run comparison

21. Run Performance Report – Compare Runs Load Test Analysis for Baseline Runs

22. Deeper Analysis

23. ALM your way

24. What’s wrong? Show me performance problems, memory usage, and exceptions Application Insights Is my application available and performing for users? One Dashboard Where do we invest next? Show me top features and customer Usage patterns Health Dashboards Notifications & Deep Insights Usage Dashboards Available SucceedingPerforming

25. Application Insights Early discovery with Alerts Actionable data w/ Log Mining Global System Monitoring Application Performance Monitoring REQUIREMENTS BACKLOG RELEASE Operate Construct WORKING SOFTWARE Build | Measure | Learn Collaboration Customer Usage Monitoring

26. 1. Telemetry is collected at each tier: Mobile applications, server applications and browser 2. Telemetry arrives to Application Insights service where it is processed & stored 3. Get 360° view of the application covering availability, performance & usage Application Insights

27. Early discovery with Alerts Actionable data w/ Log Mining Global System Monitoring Application Performance Monitoring REQUIREMENTS BACKLOG RELEASE Operate Construct WORKING SOFTWARE Build | Measure | Learn Collaboration Customer Usage Monitoring

33. One who has Ultimate and has an account with VSO Single URL to get started: http://aka.ms/loadtfshttp://aka.ms/loadtfs Application is available on the internet Can use IP Range for applications behind firewall 15,000 virtual user minutes / month $0.002 / virtual user minute after the 15,000 Support Contact Visual Studio Online support ‘vsoloadtest@Microsoft.com’ for direct contact with the team Who can use cloud load testing?

35. References Recommendation Recommendation on how to perform load testing in cloud from Visual Studio Online team Case Study Case Study on cloud load testing with Eovendo NORAD tracks Santa References

36. Visit Team System Café Today! The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics! http://www.teamsystemcafe.net

41. Run Performance Report - Trends