MICROSOFT BIG DATA

WHAT IS BIG DATA?

How do I optimize my fleet based on weather and traffic patterns? SOCIAL & WEB ANALYTICS LIVE DATA FEEDS ADVANCED ANALYTICS What’s the social sentiment for my brand or products How do I better predict future outcomes? A NEW SET OF QUESTIONS

NEW OPPORTUNITIES Massive Volumes Processes 464 billion rows per quarter, with average query time under 10 secs. Cloud Connectivity Connects across 15 social networks via the cloud for data and API access Real-Time Insight Improves operational decision making for IT managers and users

COMMON BIG DATA CUSTOMER SCENARIOS GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY Web app optimization Smart meter monitoring Equipment monitoring Advertising analysis Life sciences research Fraud detection Healthcare outcomes Weather forecasting Natural resource exploration Social network analysis Churn analysis Traffic flow optimization IT infrastructure optimization Legal discovery

THE BIG DATA LIFECYCLE

MANAGE ANY DATA, ANY SIZE, ANYWHERE

Extremely large volume of unstructured web logs Ad hoc analysis of logs to prototype patterns Hadoop data cluster feeds large 24TB cube Business users analyze cube data E.g. STRUCTURED & UNSTRUCTURED DATA

HADOOP INTEGRATED INTO THE DATA PLATFORM

POLYBASE: COMBINING RELATIONAL AND NON- RELATIONAL DATA The future of query processing HadoopData Warehouse

WHILE DRAMATICALLY SIMPLIFYING PROGRAMMING ON HADOOP Integration with.NET and new JavaScript libraries for Hadoop JS MapReduce programs in JavaScript Simplified programming Simplified deployment of MapReduce jobs Benefits Key Features Deploy JavaScript Hadoop jobs from a simple web browser on any supported device

OPEN & FLEXIBLE Tools from a rich ecosystem of partners Built with close community collaboration Hadoop for Windows JavaScript libraries Hive ODBC drivers The Apache Software Foundation 100% compatible with Apache Hadoop HDInsight built on Hortonworks Data Platform

THE BIG DATA LIFECYCLE

ENRICH BY CONNECTING TO THE WORLDS DATA Discove r Combine Refine

DISCOVER DATA FROM TO SEARCH RECOMMEND IDENTITY DOC CONTEXT SOCIAL GRAPHS DATA EXPLORER DATA HUB

POWER OF COMBINING THE WORLDS DATA Value

REFINE DATA Enterprise Information Management & Full Analytic Spectrum Credible, Consistent Data Advanced Analytics Data Mining

E.g. VALUE OF EXTERNAL DATA

THE BIG DATA LIFECYCLE

INSIGHTS ON ANY DATA, ALL USERS, WHEREVER THEY ARE

DEMO: FROM DATA TO INSIGHTS!

INSIGHTS FOR ALL USERS THROUGH FAMILIAR TOOLS PB TB GB

BIG DATA REQUIRES AN END-TO-END APPROACH DiscoverCombineRefine RelationalNon-relationalStreaming INSIGHT DATA ENRICHMENT DATA MANAGEMENT Self-ServiceCollaborationCorporate AppsDevices Analytical

MICROSOFT BIG DATA Parallel Data Warehouse PowerPivot Power View Microsoft HDInsight Server HDInsight Service

ADDITIONAL RESOURCES LEARN MORE 1. Microsoft Big Data Solution: 2. Windows Azure: 3. Microsoft BI blog: TRY NOW 1. Preview of the Windows Azure HDInsight Service: Developer CTP of Microsoft HDInsight Server for Windows Server:

26 BizSpark for Startups Accelerate 3 Years Top Partners Connect Graduation Criteria <5 Years Old <$1M Revenue Software Product Privately Held Benefits Software MSDN Ultimate Cloud Services Support Marketing

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

BIG DATA IS A GROWTH OPPORTUNITY FOR PARTNERS 1.McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast, % compound annual growth rate2 Big Data Software Growth

WHAT IS BIG DATA AND WHY NOW?

COMBINE DATA

Discover data with Data Explorer Combine with information from other sources via Azure Marketplace Refine with advanced analytics Connecting with the World’s Data MICROSOFT BIG DATA Immersive insights for all users Insights on any data Embedded insights with simplified programming Immersive Insight, Wherever you are Enterprise-ready Hadoop Windows simplicity and Manageability for Hadoop Extend data warehouse with Hadoop Scale & elasticity of the cloud Open Big Data Platform Any Data, Any Size Anywhere

Discover data with Data Explorer Combine with information from other sources via Azure Marketplace Refine with Advanced Analytics Connecting with the World’s Data MICROSOFT BIG DATA Immersive insights for all users Insights on any data Embedded insights with simplified programming Immersive Insight, Wherever you are Extend data warehouse with Hadoop Windows simplicity for Hadoop Scale & elasticity of the cloud Any Data, Any Size Anywhere Parallel Data Warehouse PowerPivot Power View

BIG DATA REQUIRES TRADITIONAL AND NEW CAPABILITIES TRADITIONAL Relational Database Management System NEW Petabyte-Scale Services

WHILE DRAMATICALLY SIMPLIFYING PROGRAMMING ON HADOOP Integration with.NET and new JavaScript libraries for Hadoop JS MapReduce programs in JavaScript Simplified programming Simplified deployment of MapReduce jobs Benefits Key Features Deploy JavaScript Hadoop jobs from a simple web browser on any supported device

HADOOP ON PREMISES AND IN THE CLOUD Enterprise-class Big Data platform on-premises Hadoop-based distribution on Windows Server with Microsoft HDInsight Elastic Big Data platform in the cloud Hadoop-based Service on Windows Azure platform Hadoop connectors for SQL Server Extend your EDW with Big Data

MANAGE ANY DATA, ANY SIZE ANYWHERE SQL Server Database & Parallel Data Warehouse Hadoop on Windows Hadoop on Azure StreamInsight Hadoop Connectors & ETL

SIMPLICITY AND MANAGEABILITY OF WINDOWS FOR HADOOP Easy setup on- premises and in the cloud Hadoop-based service with Windows Azure HDInsight Smart packaging of Hadoop on Windows with Microsoft HDInsight Integration with Microsoft System Center Simplified management Enterprise-class security Integration with Windows Server ® Active Directory

STREAMING DATA WITH STREAMINSIGHT Complex Event Processing with SteamInsight (On-premise) On-premises analysis of streaming data in real time Event Processing in the Cloud with Windows Azure SQL StreamInsight Cloud designed analysis of streaming data StreamInsight SQL StreamInsight

EXTEND YOUR DATA WAREHOUSE WITH HADOOP Integration with enterprise BI solutions Microsoft SQL Server connector for Apache Hadoop with SQOOP (SQL to Hadoop) Integration with Microsoft Data Warehousing SQL Server Parallel Data Warehouse connector for Apache Hadoop with SQOOP Deeper insights from structured and unstructured data

CONNECT HADOOP TO THE WORLD VIA WINDOWS AZURE MARKETPLACE Mashing up of internal and public data sets Integration with third-party data and services Sharing of data and insights through Windows Azure Marketplace Integration with Windows Azure Marketplace through ODATA

ENRICHMENT VIA INTEGRATION WITH SOCIAL MEDIA Integration of social media data with business applications Microsoft Codename "Social Analytics" Stronger customer relationships Integration with social media sites Models augmented with publicly available data from social media sites

ADVANCED ANALYSIS WITH HADOOP Unlock rare patterns from bespoke data mining models Mahout & Pegasus libraries already supported on Azure New business insights with predictive analytics from Microsoft Hive ODBC Driver connects Hadoop to SQL Server Data Mining tools in SSAS Support for open source Advanced Analytics tools such as Mahout & Pegasus

MICROSOFT ENTERPRISE DATA WAREHOUSING SoftwareAppliancesReference Architectures Fast Track for Dell Parallel Data Warehouse HP Enterprise Data Warehouse Dell Quickstart Data Warehouse HP Business Data Warehouse