1. Нагрузочное тестирование в облаке
#almsummit
Нагрузочное тестирование в облаке
Ефимцева Наталия
Докладчик

2. Содержание Подходы к нагрузочному тестированию
9/21/2018 3:45 AM
Содержание
Подходы к нагрузочному тестированию
Нагрузочное тестирование в облаке
С помощью «чистого» Windows Azure
С помощью Visual Studio Online!
Вопросы
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. 9/21/2018
Итак…
Load testing is a key phase in the lifecycle of any solutions as it can be used to check if a application can sustain the expected load.
Being able to run high volume, effective performance tests against a cloud or on-premises app requires more than a single workstation simply executing multiple requests concurrently.
When dealing with high loads, using a single workstation is not sufficient to generate the expected traffic as it will soon run out of system resources, whether memory, processor power, or network throughput.
A test rig needs to provide the ability to capture KPI during test runs and configure aspects like user load profiles, distribution of tests, etc.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. Типичная схема нагрузочного тестирования
9/21/2018
Типичная схема нагрузочного тестирования
Workstation: can be used to define, configure, launch and control load tests.
Test Controller: coordinates the execution of the tests across multiple test agent machines, and manage the collection of results from all the test agents.
Test Agent: each test agent machine is responsible for executing the performance tests against the system under test while collecting KPIs and then reporting results back to the controller for storage and analysis.
Load Test Repository: is a SQL Server database used as the repository for performance test results.
Note: the workstation can also act as the controller.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. Сложности нагрузочного тестирования
Microsoft Consumer Channels and Central Marketing Group
9/21/2018
Сложности нагрузочного тестирования
Подготовка\настройка машин: непросто и долго
Цена: не дешево (дорого)
Приложения в Windows Azure: есть нюансы
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Microsoft Consumer Channels and Central Marketing Group
9/21/2018
Решение
Использовать облачные Windows Azure
Скорость
провиженинга
Неограниченные
ресурсы
Экономия
Windows Azure and Visual Studio provide the ability to build a large, distributed test rig in a fast and automated way.
Virtualization of computing resources eliminates the need for dedicated hardware for load testing.
Different approaches and topologies can be used to provision a load test rig in Windows Azure in an automated way.
Entry Cost: The cost of doing load tests decreases greatly after the initial investment. Your first costs are for Visual Studio Ultimate. Once deployed, the cost of the test rig depends on Windows Azure Pay-As- You-Go pricing model.
Maintenance Cost: you can create an easily maintain a test harness in Windows Azure.
Elasticity: The load test can be easily modified to accommodate different scenarios and conditions. For example, you can configure the Azure hosted test rig with a larger number of test agents.
Repeatability: After the initial investment, you can use the same artifacts (VS cloud project or VM images) to deploy a new test rig in Windows Azure, run a load test for the necessary time and undeploy it.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Экономия. Поминутная тарификация.
9/21/2018
Экономия. Поминутная тарификация. $ 60 45 30 15
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. $ 50 100 150 В МЕСЯЦ 3 VMs, работающие 24x7 весь месяц
9/21/2018 50
100
150 В МЕСЯЦ
3 VMs, работающие 24x7 весь месяц $
80 VMs для нагрузочного тестирования
Скидка
от 33%
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Интеграция с корпоративной средой
9/21/2018
Интеграция с корпоративной средой
Windows Azure
Виртуальная сеть
<subnet 1>
<subnet 2>
<subnet 3>
DNS сервер
Site-to-Site VPN
Корпоративная среда
VPN Gateway
VPN шлюз
Point-to-Site VPN
Windows Server
2012 RRAS
Ваш ЦОД
Машины за
Корпоративным
брандмауэром
Remote workers
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10. Нагрузочное тестирование в облаке

11. Нагрузочное тестирование в облаке
Топологии тестовой среды в Windows Azure

12. Tech Ready 15
9/21/2018
Пример реализации (1\2)
Автоматизация шагов, необходимых для провижининга контроллеров и агентов для теста
Их включение в виртуальную сеть и в домен (где развернута система)
Копирование дистрибутивов Test Controller и Test Agent в BLOB хранилище
Сам облачный проект состоит из 2х worker-ролей:
Controller
Agent
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. Пример реализации (1\2)

14. Топология 1: IaaS + PaaS + hosts файл+ виртуальная сеть
TechReady 16
9/21/2018
Топология 1: IaaS + PaaS + hosts файл+ виртуальная сеть
IaaS Cloud Service 1: Visual Studio и SQL Server (Load Test DB)
PaaS Cloud Service 2: контроллер и агенты
IaaS\PaaS: тестируемая система
Виртуальная сеть
Безопасность: Pass-through authentication
Адресация: IPv4 и/или hosts файл
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Масштабирование Настройка Через портал управления Windows Azure
9/21/2018
Масштабирование
Настройка
Через портал управления Windows Azure
Через PowerShell
Set-AzureRole -ServiceName $serviceName `
-Slot $slot `
-RoleName $roleName `
-Count $count
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. Топология 2: IaaS + PaaS + DC\DNS + виртуальная сеть
IaaS Cloud Service 1: домен + DNS
IaaS Cloud Service 2: Visual Studio и SQL Server (Load Test DB)
PaaS Cloud Service 3: контроллер и агенты
PaaS Cloud Service 4: тестируемая система
Виртуальная сеть
Security: Windows аутентификация+ pass-through authentication
Адресация: DNS

17. Топология 3: локальная Visual Studio + PaaS + hosts файл + виртуальная сеть + Point-to-Site VPN
IaaS Cloud Service 1: SQL Server (Load Test DB)
PaaS Cloud Service 3: контроллер и агенты
PaaS Cloud Service 4: тестируемая система
Виртуальная сеть или VPN (Point to Site VPN)
Безопасность: Pass-through authentication
Адресация: IPv4 и/или hosts файл

18. Демонстрация Тестирование с помощью виртуальных машин в Windows Azure
9/21/2018
Демонстрация
Тестирование с помощью виртуальных машин в Windows Azure
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. Нагрузочное тестирование в облаке
Все может быть еще проще! Visual Studio Online!

20. Демонстрация Тестирование с помощью Visual Studio Online 9/21/2018
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. Предоставляемые ресурсы
Нагрузочное тестирование
Бесплатно: 15,000 минут (Virtual User) в месяц
Можно купить: $0.001\минута
Требуется Visual Studio Ultimate
Сборка
Бесплатно: 60 минут в месяц
Можно купить дополнительно: $0.025\минута
Also available are pay as you use services for hosted builds and load testing.
Azure is the billing platform for VS Online
Our services are purchased via the Azure Management Portal (credit card or Azure commitment only)
An Azure subscription is required to buy VS Online services
Free use of VS Online does not require an Azure subscription
Azure is the infrastructure running VS Online services
But no separate charges for storage, databases, VMs, etc. since VS Online is a finished service
Management of VS Online is at visualstudio.com
After you buy a user plan in the Azure Management Portal, you go to visualstudio.com to assign the plan to a user

22. Архитектура Visual Studio Пул агентов - динамически
TechEd 2013
9/21/2018 3:45 AM
Архитектура
Пул агентов - динамически
Load Test Web Service
Worker
Azure Tables
Visual Studio
Results database
Azure Blobs
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. Проверено! 12 внутренних команд разработки Внешние 10 клиенты и MVP
TechEd 2013
9/21/2018 3:45 AM
Проверено!
12 внутренних команд разработки
Включая Visual Studio Online команду и Skype
Внешние 10 клиенты и MVP
Система для выборов в штате Флорида (приложение на Windows Azure)
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

24. Выводы Облако Windows Azure дополняет традиционные ALM сценарии
9/21/2018 3:45 AM
Выводы
Облако Windows Azure дополняет традиционные ALM сценарии
Преимущества:
Экономия
Быстрота развертывания
Неограниченные ресурсы
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

25. Спасибо за внимание! 9/21/2018 3:45 AM
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.