Mobile DevOps with Visual Studio Team Services and HockeyApp Microsoft Build 2016 9/5/2018 4:34 PM Mobile DevOps with Visual Studio Team Services and HockeyApp Ervin Loh ALM Program Manager K365labs Sdn Bhd © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Mobile has happened Faster than the PC boom of the 80s Faster than the recent social networking explosion Faster than the Internet boom of the 90s Source: Flurry Analytics (link)

“ 50% of enterprise IT budgets in 2018 will be spent on mobility. IDC FutureScape: Worldwide Mobility 2017 Predictions November 2016

DevOps “habits” and “practices” RECOMMENDED PRACTICES CODE METRICS TEST AUTOMATION CODE STYLE RULES PEER CODE REVIEWS CONTINUOUS INTEGRATION CONTINUOUS UNIT TESTING ARCHITECTURAL VALIDATION REC.PRACTICES CLOUD INFRASTRUCTURE DEVELOPER SANDBOX CLOUD DEV/TEST LABS CONTAINERIZATION MICROSERVICES AUTOSCALING FAILOVER RECOMMENDED PRACTICES USER TELEMETRY USAGE MONITORING CONTINUOUS LEARNING STAKEHOLDER FEEDBACK A/B TESTING IN PRODUCTION RECOMMENDED PRACTICES CONTINUOUS INTEGRATION CONTINUOUS DEPLOYMENT RELEASE MANAGEMENT CONTINUOUS TESTING AUTONOMY & ALIGNMENT BACKLOG improved by LEARNING EVIDENCE gathered in PRODUCTION FLOW OF CUSTOMER VALUE MANAGED TECHNICAL DEBT PRODUCTION FIRST MINDSET INFRASTRUCTURE is a FLEXIBLE RESOURCE RECOMMENDED PRACTICES SELF-MANAGING TEAMS PLANNING CHATS FEATURE CREWS SPRINT RITUALS SCALED AGILE TEAM ROOMS RECOMMENDED PRACTICES TESTING IN PRODUCTION STAKEHOLDER FEEDBACK USAGE MONITORING USER TELEMETRY FEATURE FLAGS RECOMMENDED PRACTICES APPLICATION PERFORMANCE MGMT CONFIGURATION MANAGEMENT INFRASTRUCTURE AS CODE AUTOMATED RECOVERY CONTINUOUS DELIVERY RELEASE MANAGEMENT

Recommended DevOps Practices Continuous Integration Continuous Testing Continuous Deployment Release Management Self-Managing Teams Feature Crews Scaled Agile Continuous Learning Testing (in Production) Continuous Feedback Usage Monitoring Telemetry Collection Experimentation Testing in Production Code Quality Analysis Peer Code Reviews Automated Testing Architecture Validation Code Style Rules Continuous Delivery App Performance Mgmt. Infrastructure as Code Automated Recovery Cloud Infrastructure Developer Sandboxing Cloud Dev and Test Automatic Scaling Visual Studio Features Flexible Source Control Git, Github, remote Git or TFVC (Distributed or centralized source control) Modern Code Workflows Pull requests, branch policies, code reviews, checkin policies, code collaboration Cross-Platform Build Supports iOS, Android, Java, OS X, Linux, .net Flexible and extensible Cloud or on-premises CI builds Parallel builds Unit tests Selenium tests Xamarin Test Cloud (Automated Device Testing) Test Result Analysis HockeyApp Agile Tools Kanban Boards Scrum/Task Boards Work Item Tracking Portfolio Management Capacity Planning Enterprise Collaboration Team Rooms Code Collaboration Code reviews Test & Feedback Dashboards & Charts Any platform, any code, any language, any app Code Search Exploratory Testing Feedback Management Stakeholder Feedback Inline test execution and creation from Agile boards Web based test execution Application Insights App telemetry Usage analytics Beta Test Distribution Feedback Collection Manual Testing Test Case Management Cloud Dev/Test Environments Azure Dev/Test Labs Azure VMs Azure App Services Azure Resource Manager +1 Concurrent pipeline Rolling deployments CodedUI Testing Performance & Load Testing Cloud Load Testing Code Coverage Intellitest Fakes&Stubs IntelliTrace (in Production) RT/Live Experiences: RT Architecture Validation RT Continuous Testing RT Style & Code Analysis IntelliTest IntelliTrace Code Maps Visual Debugging Code Analysis Package Management Lab Management Features in red = Sold separately

What do we mean by “Mobile DevOps”? 9/5/2018 4:34 PM What do we mean by “Mobile DevOps”? Streamlining the development of your mobile app(s) Frequently releasing value to users Constantly maintaining quality Monitoring app health and engagement in real-time Automating the process to be repeatable & sustainable Continuous Integration (CI) Continuous Delivery (CD) Continuous Monitoring (CM) © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continuous Integration (CI) 9/5/2018 4:34 PM Continuous Integration (CI) How can you iterate quickly, while still maintaining quality? Recommendations: Setup an automated build server that runs on every check-in Author automated tests and run them as part of your build Use a test cloud to achieve high device coverage © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Visual Studio Team Services (VSTS) / TFS 9/5/2018 4:34 PM Visual Studio Team Services (VSTS) / TFS Version Control Git and Team Foundation Version Control (TFVC) Unlimited private repos Agile Planning Work item tracking Kanban, backlogs, task boards Continuous Integration Cloud-hosted build agents Build support for all mobile platforms Integration with test clouds © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Perfecto Mobile Cloud Device Lab VSTS Integration Manually test w/ 1,000s of devices Provision directly in the browser VSTS Integration Automate uploading new builds Parallel test execution

Demo Step #1: Navigating Around PerfectoMobile Microsoft Build 2016 9/5/2018 4:34 PM Demo Step #1: Navigating Around PerfectoMobile © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continuous Delivery (CD) - Beta 9/5/2018 4:34 PM Continuous Delivery (CD) - Beta How can you get early feedback from your testers on every build? Recommendations: Conduct a continuous beta program to collect feedback Automate the deployment of new builds from your CI server Monitor crash reports to catch issues early © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

HockeyApp Distribution Crash Reporting Feedback In-house app store 9/5/2018 4:34 PM HockeyApp Distribution In-house app store Notify testers of updates Crash Reporting Real-time collection “Symbolicated” stacks Feedback Gather in-app feedback Respond directly to testers © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo Step #2: Distributing builds to beta testers w/HockeyApp Microsoft Build 2016 9/5/2018 4:34 PM Demo Step #2: Distributing builds to beta testers w/HockeyApp © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continuous Delivery (CD) - Production 9/5/2018 4:34 PM Continuous Delivery (CD) - Production How can you automate your production deployments once a release is signed-off? Recommendations: Setup a multi-environment release process (e.g. beta and production) Assign the necessary stakeholders to sign-off on beta/staging builds Automate as much of this workflow as possible © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Release Management (VSTS) 9/5/2018 4:34 PM Release Management (VSTS) Continuous Delivery Define per-environment release pipeline Trigger manually or via successful builds Approval Policies Configure per-environment sign-offs Manual validation requirements Release Visibility View per-environment release status Track release back to commits © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo Step #3: Release Management w/VSTS and HockeyApp Microsoft Build 2016 9/5/2018 4:34 PM Demo Step #3: Release Management w/VSTS and HockeyApp © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continuous Delivery (CD) – OTA Updates 9/5/2018 4:34 PM Continuous Delivery (CD) – OTA Updates How can you release app updates even quicker, by skipping the app store submission entirely? Recommendations: If using a JS-based mobile platform, use an over-the-air update service Automate the release process from your CI builds © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

CodePush Cloud-hosted mobile app deployment service Managed via cross-platform CLI Simple, yet comprehensive Cordova and React Native SDKs

Demo Step #4: Releasing OTA updates w/CodePush Microsoft Build 2016 9/5/2018 4:34 PM Demo Step #4: Releasing OTA updates w/CodePush © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continuous Monitoring 9/5/2018 4:34 PM Continuous Monitoring How can you better understand your users and how they engage with your app? Recommendations: Track DAU/MAU to understand user acquisition and retention Instrument your app with custom events to better understand user engagement of specific features ? © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo Step #5: Tracking user engagement w/HockeyApp Microsoft Build 2016 9/5/2018 4:34 PM Demo Step #5: Tracking user engagement w/HockeyApp © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

So what did “Mobile DevOps” help us accomplish? 9/5/2018 4:34 PM So what did “Mobile DevOps” help us accomplish? Automating our build and release process using VSTS Maintain product quality with Perfect Mobile tests Capturing crash reports and usage data via HockeyApp Releasing instant app updates via CodePush © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Additional Resources Check out the following resources for more info: 9/5/2018 4:34 PM Additional Resources Check out the following resources for more info: VSTS – http://visualstudio.com Perfecto Mobile – http://perfectomobile.com HockeyApp – http://hockeyapp.net CodePush – http://codepush.tools Go through the Mobile DevOps lab: http://aka.ms/MobileDev1 © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

A leader in 17 Gartner Magic Quadrants Application Lifecycle Management 2015 Mobile Application Development Platforms 2016 Enterprise Application Platform-as-a-Service 2016 Mission-critical Database Management Systems 2016

9/5/2018 4:34 PM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.