Download presentation
Presentation is loading. Please wait.
Published byVirgil Lyons Modified over 9 years ago
1
MICROSOFT BIG DATA
2
WHAT IS BIG DATA?
3
How do I optimize my fleet based on weather and traffic patterns? SOCIAL & WEB ANALYTICS LIVE DATA FEEDS ADVANCED ANALYTICS What’s the social sentiment for my brand or products How do I better predict future outcomes? A NEW SET OF QUESTIONS
4
NEW OPPORTUNITIES Massive Volumes Processes 464 billion rows per quarter, with average query time under 10 secs. Cloud Connectivity Connects across 15 social networks via the cloud for data and API access Real-Time Insight Improves operational decision making for IT managers and users
5
COMMON BIG DATA CUSTOMER SCENARIOS GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY Web app optimization Smart meter monitoring Equipment monitoring Advertising analysis Life sciences research Fraud detection Healthcare outcomes Weather forecasting Natural resource exploration Social network analysis Churn analysis Traffic flow optimization IT infrastructure optimization Legal discovery
6
THE BIG DATA LIFECYCLE
7
MANAGE ANY DATA, ANY SIZE, ANYWHERE 010101010101010101 1010101010101010 01010101010101 101010101010
8
Extremely large volume of unstructured web logs Ad hoc analysis of logs to prototype patterns Hadoop data cluster feeds large 24TB cube Business users analyze cube data E.g. STRUCTURED & UNSTRUCTURED DATA
9
HADOOP INTEGRATED INTO THE DATA PLATFORM
10
POLYBASE: COMBINING RELATIONAL AND NON- RELATIONAL DATA The future of query processing HadoopData Warehouse
11
WHILE DRAMATICALLY SIMPLIFYING PROGRAMMING ON HADOOP Integration with.NET and new JavaScript libraries for Hadoop JS MapReduce programs in JavaScript Simplified programming Simplified deployment of MapReduce jobs Benefits Key Features Deploy JavaScript Hadoop jobs from a simple web browser on any supported device
12
OPEN & FLEXIBLE Tools from a rich ecosystem of partners Built with close community collaboration Hadoop for Windows JavaScript libraries Hive ODBC drivers The Apache Software Foundation 100% compatible with Apache Hadoop HDInsight built on Hortonworks Data Platform
13
THE BIG DATA LIFECYCLE
14
ENRICH BY CONNECTING TO THE WORLDS DATA Discove r Combine Refine
15
DISCOVER DATA FROM TO SEARCH RECOMMEND IDENTITY DOC CONTEXT SOCIAL GRAPHS DATA EXPLORER DATA HUB
16
POWER OF COMBINING THE WORLDS DATA Value
17
REFINE DATA Enterprise Information Management & Full Analytic Spectrum Credible, Consistent Data Advanced Analytics Data Mining
18
E.g. VALUE OF EXTERNAL DATA
19
THE BIG DATA LIFECYCLE
20
INSIGHTS ON ANY DATA, ALL USERS, WHEREVER THEY ARE 010101010101010101 1010101010101010 01010101010101 101010101010
21
DEMO: FROM DATA TO INSIGHTS!
22
INSIGHTS FOR ALL USERS THROUGH FAMILIAR TOOLS PB TB GB
23
BIG DATA REQUIRES AN END-TO-END APPROACH DiscoverCombineRefine RelationalNon-relationalStreaming INSIGHT DATA ENRICHMENT DATA MANAGEMENT Self-ServiceCollaborationCorporate AppsDevices Analytical
24
MICROSOFT BIG DATA Parallel Data Warehouse PowerPivot Power View Microsoft HDInsight Server HDInsight Service
25
ADDITIONAL RESOURCES LEARN MORE 1. Microsoft Big Data Solution: www.microsoft.com/bigdatawww.microsoft.com/bigdata 2. Windows Azure: www.windowsazure.com/en-us/home/scenarios/big-datawww.windowsazure.com/en-us/home/scenarios/big-data 3. Microsoft BI blog: http://blogs.msdn.com/b/microsoft_business_intelligence1/ http://blogs.msdn.com/b/microsoft_business_intelligence1/ TRY NOW 1. Preview of the Windows Azure HDInsight Service: https://www.hadooponazure.com https://www.hadooponazure.com 2. Developer CTP of Microsoft HDInsight Server for Windows Server: http://www.microsoft.com/bigdata http://www.microsoft.com/bigdata
26
26 BizSpark for Startups Accelerate 3 Years Top Partners Connect Graduation Criteria <5 Years Old <$1M Revenue Software Product Privately Held Benefits Software MSDN Ultimate Cloud Services Support Marketing
27
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
28
BIG DATA IS A GROWTH OPPORTUNITY FOR PARTNERS 1.McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, 2012 2.IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast, 2012 39% compound annual growth rate2 Big Data Software Growth
29
WHAT IS BIG DATA AND WHY NOW?
30
COMBINE DATA
31
Discover data with Data Explorer Combine with information from other sources via Azure Marketplace Refine with advanced analytics Connecting with the World’s Data MICROSOFT BIG DATA Immersive insights for all users Insights on any data Embedded insights with simplified programming Immersive Insight, Wherever you are Enterprise-ready Hadoop Windows simplicity and Manageability for Hadoop Extend data warehouse with Hadoop Scale & elasticity of the cloud Open Big Data Platform Any Data, Any Size Anywhere
32
Discover data with Data Explorer Combine with information from other sources via Azure Marketplace Refine with Advanced Analytics Connecting with the World’s Data MICROSOFT BIG DATA Immersive insights for all users Insights on any data Embedded insights with simplified programming Immersive Insight, Wherever you are Extend data warehouse with Hadoop Windows simplicity for Hadoop Scale & elasticity of the cloud Any Data, Any Size Anywhere Parallel Data Warehouse PowerPivot Power View
33
BIG DATA REQUIRES TRADITIONAL AND NEW CAPABILITIES TRADITIONAL Relational Database Management System NEW Petabyte-Scale Services
34
WHILE DRAMATICALLY SIMPLIFYING PROGRAMMING ON HADOOP Integration with.NET and new JavaScript libraries for Hadoop JS MapReduce programs in JavaScript Simplified programming Simplified deployment of MapReduce jobs Benefits Key Features Deploy JavaScript Hadoop jobs from a simple web browser on any supported device
35
HADOOP ON PREMISES AND IN THE CLOUD Enterprise-class Big Data platform on-premises Hadoop-based distribution on Windows Server with Microsoft HDInsight Elastic Big Data platform in the cloud Hadoop-based Service on Windows Azure platform Hadoop connectors for SQL Server Extend your EDW with Big Data
36
MANAGE ANY DATA, ANY SIZE ANYWHERE SQL Server Database & Parallel Data Warehouse Hadoop on Windows Hadoop on Azure 1010101010101010 01010101010101 101010101010 StreamInsight Hadoop Connectors & ETL
37
SIMPLICITY AND MANAGEABILITY OF WINDOWS FOR HADOOP Easy setup on- premises and in the cloud Hadoop-based service with Windows Azure HDInsight Smart packaging of Hadoop on Windows with Microsoft HDInsight Integration with Microsoft System Center Simplified management Enterprise-class security Integration with Windows Server ® Active Directory
38
STREAMING DATA WITH STREAMINSIGHT Complex Event Processing with SteamInsight (On-premise) On-premises analysis of streaming data in real time Event Processing in the Cloud with Windows Azure SQL StreamInsight Cloud designed analysis of streaming data StreamInsight SQL StreamInsight
39
EXTEND YOUR DATA WAREHOUSE WITH HADOOP Integration with enterprise BI solutions Microsoft SQL Server connector for Apache Hadoop with SQOOP (SQL to Hadoop) Integration with Microsoft Data Warehousing SQL Server Parallel Data Warehouse connector for Apache Hadoop with SQOOP Deeper insights from structured and unstructured data
40
CONNECT HADOOP TO THE WORLD VIA WINDOWS AZURE MARKETPLACE Mashing up of internal and public data sets Integration with third-party data and services Sharing of data and insights through Windows Azure Marketplace Integration with Windows Azure Marketplace through ODATA
41
ENRICHMENT VIA INTEGRATION WITH SOCIAL MEDIA Integration of social media data with business applications Microsoft Codename "Social Analytics" Stronger customer relationships Integration with social media sites Models augmented with publicly available data from social media sites
42
ADVANCED ANALYSIS WITH HADOOP Unlock rare patterns from bespoke data mining models Mahout & Pegasus libraries already supported on Azure New business insights with predictive analytics from Microsoft Hive ODBC Driver connects Hadoop to SQL Server Data Mining tools in SSAS Support for open source Advanced Analytics tools such as Mahout & Pegasus
43
MICROSOFT ENTERPRISE DATA WAREHOUSING SoftwareAppliancesReference Architectures Fast Track for Dell Parallel Data Warehouse HP Enterprise Data Warehouse Dell Quickstart Data Warehouse HP Business Data Warehouse
Similar presentations
© 2024 SlidePlayer.com Inc.
All rights reserved.