1. Mobile DevOps with Visual Studio Team Services and HockeyApp
Microsoft Build 2016
9/5/2018 4:34 PM
Mobile DevOps with Visual Studio Team Services and HockeyApp
Ervin Loh
ALM Program Manager
K365labs Sdn Bhd
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Mobile has happened Faster than the PC boom of the 80s
Faster than the recent social networking explosion
Faster than the Internet boom of the 90s
Source: Flurry Analytics (link)

3. “ 50% of enterprise IT budgets in 2018 will be spent on mobility.
IDC FutureScape: Worldwide Mobility 2017 Predictions
November 2016

4. DevOps “habits” and “practices”
RECOMMENDED PRACTICES
CODE METRICS
TEST AUTOMATION
CODE STYLE RULES
PEER CODE REVIEWS
CONTINUOUS INTEGRATION
CONTINUOUS UNIT TESTING
ARCHITECTURAL VALIDATION
REC.PRACTICES
CLOUD INFRASTRUCTURE
DEVELOPER SANDBOX
CLOUD DEV/TEST LABS
CONTAINERIZATION
MICROSERVICES
AUTOSCALING
FAILOVER
RECOMMENDED PRACTICES
USER TELEMETRY
USAGE MONITORING
CONTINUOUS LEARNING
STAKEHOLDER FEEDBACK
A/B TESTING IN PRODUCTION
RECOMMENDED PRACTICES
CONTINUOUS INTEGRATION
CONTINUOUS DEPLOYMENT
RELEASE MANAGEMENT
CONTINUOUS TESTING
AUTONOMY & ALIGNMENT
BACKLOG improved by LEARNING
EVIDENCE gathered in PRODUCTION
FLOW OF CUSTOMER VALUE
MANAGED TECHNICAL DEBT
PRODUCTION FIRST MINDSET
INFRASTRUCTURE is a FLEXIBLE RESOURCE
RECOMMENDED PRACTICES
SELF-MANAGING TEAMS
PLANNING CHATS
FEATURE CREWS
SPRINT RITUALS
SCALED AGILE
TEAM ROOMS
RECOMMENDED PRACTICES
TESTING IN PRODUCTION
STAKEHOLDER FEEDBACK
USAGE MONITORING
USER TELEMETRY
FEATURE FLAGS
RECOMMENDED PRACTICES
APPLICATION PERFORMANCE MGMT
CONFIGURATION MANAGEMENT
INFRASTRUCTURE AS CODE
AUTOMATED RECOVERY
CONTINUOUS DELIVERY
RELEASE MANAGEMENT

5. Recommended DevOps Practices
Continuous Integration
Continuous Testing
Continuous Deployment
Release Management
Self-Managing Teams
Feature Crews
Scaled Agile
Continuous Learning
Testing (in Production)
Continuous Feedback
Usage Monitoring
Telemetry Collection
Experimentation
Testing in Production
Code Quality Analysis
Peer Code Reviews
Automated Testing
Architecture Validation
Code Style Rules
Continuous Delivery
App Performance Mgmt.
Infrastructure as Code
Automated Recovery
Cloud Infrastructure
Developer Sandboxing
Cloud Dev and Test
Automatic Scaling
Visual Studio Features
Flexible Source Control
Git, Github, remote Git or TFVC (Distributed or centralized source control)
Modern Code Workflows
Pull requests, branch policies, code reviews, checkin policies, code collaboration
Cross-Platform Build
Supports iOS, Android, Java, OS X, Linux, .net
Flexible and extensible
Cloud or on-premises
CI builds
Parallel builds
Unit tests
Selenium tests
Xamarin Test Cloud (Automated Device Testing)
Test Result Analysis
HockeyApp
Agile Tools
Kanban Boards
Scrum/Task Boards
Work Item Tracking
Portfolio Management
Capacity Planning
Enterprise Collaboration
Team Rooms
Code Collaboration
Code reviews
Test & Feedback
Dashboards & Charts
Any platform, any code, any language, any app
Code Search
Exploratory Testing
Feedback Management
Stakeholder Feedback
Inline test execution and creation from Agile boards
Web based test execution
Application Insights
App telemetry
Usage analytics
Beta Test Distribution
Feedback Collection
Manual Testing
Test Case Management
Cloud Dev/Test Environments
Azure Dev/Test Labs
Azure VMs
Azure App Services
Azure Resource Manager
+1 Concurrent pipeline
Rolling deployments
CodedUI Testing
Performance & Load Testing
Cloud Load Testing
Code Coverage
Intellitest
Fakes&Stubs
IntelliTrace (in Production)
RT/Live Experiences:
RT Architecture Validation
RT Continuous Testing
RT Style & Code Analysis
IntelliTest
IntelliTrace
Code Maps
Visual Debugging
Code Analysis
Package Management
Lab Management
Features in red =
Sold separately

6. What do we mean by “Mobile DevOps”?
9/5/2018 4:34 PM
What do we mean by “Mobile DevOps”?
Streamlining the development of your mobile app(s)
Frequently releasing value to users
Constantly maintaining quality
Monitoring app health and engagement in real-time
Automating the process to be repeatable & sustainable
Continuous Integration (CI)
Continuous Delivery (CD)
Continuous Monitoring (CM)
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Continuous Integration (CI)
9/5/2018 4:34 PM
Continuous Integration (CI)
How can you iterate quickly, while still maintaining quality?
Recommendations:
Setup an automated build server that runs on every check-in
Author automated tests and run them as part of your build
Use a test cloud to achieve high device coverage
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. Visual Studio Team Services (VSTS) / TFS
9/5/2018 4:34 PM
Visual Studio Team Services (VSTS) / TFS
Version Control
Git and Team Foundation Version Control (TFVC)
Unlimited private repos
Agile Planning
Work item tracking
Kanban, backlogs, task boards
Continuous Integration
Cloud-hosted build agents
Build support for all mobile platforms
Integration with test clouds
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Perfecto Mobile Cloud Device Lab VSTS Integration
Manually test w/ 1,000s of devices
Provision directly in the browser
VSTS Integration
Automate uploading new builds
Parallel test execution

10. Demo Step #1: Navigating Around PerfectoMobile Microsoft Build 2016
9/5/2018 4:34 PM
Demo
Step #1: Navigating Around PerfectoMobile
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. Continuous Delivery (CD) - Beta
9/5/2018 4:34 PM
Continuous Delivery (CD) - Beta
How can you get early feedback from your testers on every build?
Recommendations:
Conduct a continuous beta program to collect feedback
Automate the deployment of new builds from your CI server
Monitor crash reports to catch issues early
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

12. HockeyApp Distribution Crash Reporting Feedback In-house app store
9/5/2018 4:34 PM
HockeyApp
Distribution
In-house app store
Notify testers of updates
Crash Reporting
Real-time collection
“Symbolicated” stacks
Feedback
Gather in-app feedback
Respond directly to testers
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. Demo Step #2: Distributing builds to beta testers w/HockeyApp
Microsoft Build 2016
9/5/2018 4:34 PM
Demo
Step #2: Distributing builds to beta testers w/HockeyApp
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Continuous Delivery (CD) - Production
9/5/2018 4:34 PM
Continuous Delivery (CD) - Production
How can you automate your production deployments once a release is signed-off?
Recommendations:
Setup a multi-environment release process (e.g. beta and production)
Assign the necessary stakeholders to sign-off on beta/staging builds
Automate as much of this workflow as possible
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Release Management (VSTS)
9/5/2018 4:34 PM
Release Management (VSTS)
Continuous Delivery
Define per-environment release pipeline
Trigger manually or via successful builds
Approval Policies
Configure per-environment sign-offs
Manual validation requirements
Release Visibility
View per-environment release status
Track release back to commits
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. Demo Step #3: Release Management w/VSTS and HockeyApp
Microsoft Build 2016
9/5/2018 4:34 PM
Demo
Step #3: Release Management w/VSTS and HockeyApp
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

17. Continuous Delivery (CD) – OTA Updates
9/5/2018 4:34 PM
Continuous Delivery (CD) – OTA Updates
How can you release app updates even quicker, by skipping the app store submission entirely?
Recommendations:
If using a JS-based mobile platform, use an over-the-air update service
Automate the release process from your CI builds
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. CodePush Cloud-hosted mobile app deployment service
Managed via cross-platform CLI
Simple, yet comprehensive Cordova and React Native SDKs

19. Demo Step #4: Releasing OTA updates w/CodePush Microsoft Build 2016
9/5/2018 4:34 PM
Demo
Step #4: Releasing OTA updates w/CodePush
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Continuous Monitoring
9/5/2018 4:34 PM
Continuous Monitoring
How can you better understand your users and how they engage with your app?
Recommendations:
Track DAU/MAU to understand user acquisition and retention
Instrument your app with custom events to better understand user engagement of specific features ?
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. Demo Step #5: Tracking user engagement w/HockeyApp
Microsoft Build 2016
9/5/2018 4:34 PM
Demo
Step #5: Tracking user engagement w/HockeyApp
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. So what did “Mobile DevOps” help us accomplish?
9/5/2018 4:34 PM
So what did “Mobile DevOps” help us accomplish?
Automating our build and release process using VSTS
Maintain product quality with Perfect Mobile tests
Capturing crash reports and usage data via HockeyApp
Releasing instant app updates via CodePush
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. Additional Resources Check out the following resources for more info:
9/5/2018 4:34 PM
Additional Resources
Check out the following resources for more info:
VSTS –
Perfecto Mobile –
HockeyApp –
CodePush –
Go through the Mobile DevOps lab:
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

24. A leader in 17 Gartner Magic Quadrants
Application Lifecycle Management
2015
Mobile Application
Development Platforms
2016
Enterprise Application Platform-as-a-Service
2016
Mission-critical Database Management Systems
2016

25. 9/5/2018 4:34 PM
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.