Platinu m Sponsor s Silver Sponsors Gold Sponsor s

Conference Mobile App dodn14.azurewebsites.net Quick access to conference info Build your custom agenda Anonymously rate the sessions you attended Share with the Twitter-verse

Fun Stuff Downstairs

Agenda Cloud load testing

Load testing How will the application behave in front of the expected users load? Performance testing How fast will the application code perform? Stress testing What is point of users-load that will break your application? Capacity planning Will the application be able to scale up to the expected future capacity? Why Load Testing?

Target Server Agent Visual Studio Ultimate Test Controller Target Server Collector Agent Agent Collect ASP.NET profiler traces Unlimited Load Test Virtual Users

Install your controllers/agents Physically setup computers Replicate this to all the computers Buy appropriate computers Net load testing can be: What is needed to make that work?  Expensive to setup  Provisioning is complex  Slow to scale  Costly to maintain

Announcing: Easier Load Testing Quickly define and configure simple load tests Use the elastic scale of VSO to simulate hundreds or thousands of virtual users Measure the underlying system using Application Insights

Announcing: Easier Load Testing

Architecture Visual Studio Load Test Web Service Test Agent Pool - Dynamic Results database Worker Azure Blobs Azure Tables

What do you load test? Websites Web Services Databases NOT the User Interface

Get infrastructure in cloud when you need it. No need to setup your own infrastructure and maintain it. Use the same load test project which you use for on premises today. Scale out easily in case of doing stress testing. Benefits of cloud load testing

Run Performance Report Load Test Analysis Built into Excel for run comparison

Run Performance Report – Compare Runs Load Test Analysis for Baseline Runs

Deeper Analysis

ALM your way

What’s wrong? Show me performance problems, memory usage, and exceptions Application Insights Is my application available and performing for users? One Dashboard Where do we invest next? Show me top features and customer Usage patterns Health Dashboards Notifications & Deep Insights Usage Dashboards Available SucceedingPerforming

Application Insights Early discovery with Alerts Actionable data w/ Log Mining Global System Monitoring Application Performance Monitoring REQUIREMENTS BACKLOG RELEASE Operate Construct WORKING SOFTWARE Build | Measure | Learn Collaboration Customer Usage Monitoring

1. Telemetry is collected at each tier: Mobile applications, server applications and browser 2. Telemetry arrives to Application Insights service where it is processed & stored 3. Get 360° view of the application covering availability, performance & usage Application Insights

Early discovery with Alerts Actionable data w/ Log Mining Global System Monitoring Application Performance Monitoring REQUIREMENTS BACKLOG RELEASE Operate Construct WORKING SOFTWARE Build | Measure | Learn Collaboration Customer Usage Monitoring

One who has Ultimate and has an account with VSO Single URL to get started: Application is available on the internet Can use IP Range for applications behind firewall 15,000 virtual user minutes / month $0.002 / virtual user minute after the 15,000 Support Contact Visual Studio Online support for direct contact with the team Who can use cloud load testing?

References Recommendation Recommendation on how to perform load testing in cloud from Visual Studio Online team Case Study Case Study on cloud load testing with Eovendo NORAD tracks Santa References

Visit Team System Café Today! The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!

Run Performance Report - Trends