AI development using Data Science Virtual Machines (DSVM) in Azure

Slides:



Advertisements
Similar presentations
MIX 09 4/15/ :14 PM © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered.
Advertisements

Session 1.
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or.
Microsoft Teams Behind the Scenes – Q&A
From IT Pros to IT Heroes - with Azure DevTest Labs
Azure Machine Learning Deploying and Managing Models in production
MIX 09 5/29/ :31 AM © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered.
Use any Amazon S3 application with Azure Blob Storage
6/5/2018 1:30 PM THR1029 Spend less time managing data and more time with customers: Quick tour of Outlook Customer Manager Welly Lee
DevOps for any language
Azure Cloud Shell Magic of Modern Command-line Management
Azure SDKs and Tools for You
Do more with Microsoft Word and Office 365
What a Real, Functioning DevOps Team Looks Like
Virtual Machine Diagnostics in Microsoft Azure
7/22/2018 9:21 PM BRK3270 Building a Better Data Solution: Microsoft SQL Server and Azure Data Services Joey D’Antoni Principal Consultant Denny Cherry.
SQL Server on Linux on All-Flash Arrays
Microsoft Ignite /31/ :08 AM
8/6/ :17 AM THR2214 Hybrid Cloud Activated A customer case study optimizing on-premises & Azure performance and cost Mor Cohen-Tal Senior Product.
SQL Server for Java developers
Workflow Orchestration with Adobe I/O
Customize Office 365 Search and create result sources
How we got a traditional bank collaborating across boundaries
9/12/2018 7:18 AM THR1081 Don’t be the first victim of new malware Turn Windows Defender AV Cloud Protection on! Amitai Senior Program.
Azure Security in four steps
Automate all things! Microsoft Azure continuous deployment
9/14/ :46 AM BRK3293 How the Portland Trail Blazers Use Personalization and Acxiom Data to Target Customers Chris Hoder Program Manager, AI + Research.
Modern Front-End Web Development with Visual Studio
Agile Planning with Visual Studio Team Services (VSTS)
Servicing Windows 10 in the Real World
9/22/2018 3:49 AM BRK2247 Learn from MVPs: Panel discussion on all things SharePoint and OneDrive © Microsoft Corporation. All rights reserved. MICROSOFT.
Confidence at speed: Visual Studio 2017 and your CI pipeline
Azure PowerShell Aaron Roney Senior Program Manager Cormac McCarthy
Continuous Delivery for Microsoft Azure
Port your AWS Knowledge to Azure
Continuous Delivery with Visual Studio Team Services
Azure Advisor: Optimization in the best way
PowerShell Unplugged Jeffrey Snover Technical Fellow
Mobile Center and VSTS:​ Better together for your Mobile DevOps
Accelerate Office 365 Adoption Through Microsoft FastTrack Services
Microsoft products for non-profits
Power-up NoSQL with Azure Cosmos DB
Introduction to ASP.NET Core 1.0
Five cool things you can do with Windows PowerShell on Office 365
Securely pass passwords into your deployment
Microsoft Exchange: Through the eyes of MVPs (Panel discussion)
MDM Migration Analysis Tool (MMAT)
Overview: Dynamics 365 for Project Service Automation
Virtual Reality with Azure and Unity
Understand your Azure cloud assets dependencies with BMC Discovery
Breaking Down the Value of A Yammer Post: 20 Things to Do
Cool Microsoft Edge Tips and Tricks
When Bad Things Happen to Good Applications
Getting the most out of Azure resources with Azure Advisor
Manage your App Service resources using Command line tools
“Hey Mom, I’ll Fix Your Computer”
4/21/2019 7:09 AM THR2098 Unlock New Opportunities with Nintex Hawkeye Process Intelligence and Workflow Analytics Sr. Product.
Business Continuity and the Microsoft Cloud
Виктор Хаджийски Катедра “Металургия на желязото и металолеене”
Consolidate, manage, backup, and secure your cloud content
Designing Bots that Fit Your Organization
Ask the Experts: Windows 10 deployment and servicing
Passwordless Service Accounts
Шитманов Дархан Қаражанұлы Тарих пәнінің
Digital Transformation: Putting the Jigsaw Together
WCF and .NET Framework Microservices in Containers
Diagnostics and troubleshooting in Azure App Service Support Center
Optimizing your content for search and discovery
Building Data-Driven Applications Using "Quadrant" and "M"
Presentation transcript:

AI development using Data Science Virtual Machines (DSVM) in Azure 6/17/2018 3:49 AM BRK2370 AI development using Data Science Virtual Machines (DSVM) in Azure Gopi Kumar Principal Program Manager Lead AI & Research Barnam Bora Program Manager AI & Research © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda Introduction to the Data Science Virtual Machines (DSVM) in Azure New Announcements AI Development Workflow & Why DSVM Introducing New Offerings Deepdive 1 Deepdive 2 Resources & Next Steps Q&A “500,000 Tweets relating to AI / ML collected processed in SQL Server & R Server using ScaleR functions.”

Data Science Virtual Machines (DSVM) Pre-Configured environments in the cloud for Data Science & AI Modeling, Development & Deployment.

Data Science Virtual Machines (DSVM) DSVM – Windows Server 2016 Editions DSVM – Linux – Ubuntu Deep Learning Virtual Machines

DSVM Announcements Azure Gov on AI for Earth Azure China New Samples Deep Learning VM Azure Gov on AI for Earth Azure China New Samples Batch AI Training Azure Machine Learning

End-to-End AI Development Workflow using Data Science Virtual Machines (DSVM)

Why Data Science VMs ? Examples & Templates to get started

The Deep Learning VM Windows Server 2016 and Ubuntu releases Physical Card = 2 x NVidia TESLA GPUs Use NC class Azure VMs with GPUs Great for Deep Learning workloads

Deepdive Gopi Kumar 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Team Data Science Process (TDSP) Business Understanding Deployment Modeling (ML/AI) Data acquisition & understanding Agile, iterative data science process to improve collaboration, quality and productivity http://aka.ms/tdsp © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Iterative Development with DSVM Local tools Local Debug Faster experimentation Single VM Development Larger VMs GPU Scale Up Multi Node Remote Spark Batch Nodes VM Scale Sets Scale Out

Problem: Extract entities in Medical Documents Dataset: MEDLINE corpus 27 Millions abstracts 800+ XML Files Textual data

Architecture

Deepdive Barnam Bora 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Problem: Product Detection from images Training Dataset: 60 Retail Product Images Metadata Labels Microsoft Cognitive Toolkit

Storage Resources Azure Blob Storage Azure Cosmos DB Images files for Training & Scoring Metadata about Images

Training Model on the DSVM + Publish Web-service Azure Blob Storage Azure Cosmos DB DSVM – Windows Server 2016 Trained Model Web Service

API in Azure Cosmos DB 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Resources DNN Training Workflow

6/17/2018 3:49 AM Next Steps Hands-on Lab – HOL3034 (Ignite only) https://aka.ms/dsvm/ignitehol Free Test Drive http://aka.ms/dsvm/testdrive © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Take a free test drive: http://aka.ms/dsvm/testdrive Reference DSVM Forum - send questions, feedback and feature requests on the forum - http://aka.ms/dsvm/forum DSVM Product Page – http://aka.ms/dsvm DSVM Introductory DIY workshop – http://aka.ms/dsvm/workshop Video Recorded Session– http://aka.ms/dsvm/webinar Learn Analytics @ Microsoft – http://learnanalytics.microsoft.com GitHub Link – https://github.com/Azure/DataScienceVM Take a free test drive: http://aka.ms/dsvm/testdrive

6/17/2018 3:49 AM Q & A © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session Tech Ready 15 6/17/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.