But, my customer isn’t CERN and doesn’t have a Large Hadron Collider…
But your customers do have… SensorsClicksLogs Transactional records Call centersImages Documents Signals from social media Simulations
Big Data is All This and More: volume, variety, velocity (and volatility & variability) Traditional Data is Highly Structured traditional databases are organized around planned queries A Definition
Web app optimization Smart meter monitoring Equipment monitoring Advertising analysis Life sciences research Fraud detection Healthcare outcomes Weather forecasting Social network analysis Churn analysis Traffic flow optimization IT infrastructure optimization Legal discovery Natural resource exploration GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN THEIR INDUSTRY Common Big Data Customer Scenarios
Demo Twitter Analytics Demo with Microsoft Excel
Big Data is more than just new BI! Big Data is more than just Hadoop!
Fast Load Source Systems Historical Data (Beyond Active Window) Summarize & Load Big Data Sources (Raw, Unstructured) Alerts, Notifications Data & Compute Intensive Application ERPCRMLOB APPS Integrate/Enrich SQL Server StreamInsight Enterprise ETL with SSIS, DQS, MDS HDInsight on Windows Azure HDInsight on Windows Server SQL Server FTDW Data Marts SQL Server Reporting Services SQL Server Analysis Server Business Insights Interactive Reports Performance Scorecards Crawlers Bots Devices Sensors SQL Server Parallel Data Warehouse Azure Market Place The Big (Data) Picture, 4 main topics:
The Traditional Data Warehouse 14 … data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. – Gartner, “The State of Data Warehousing in 2012” Data sources
The Traditional Data Warehouse 15 Data sources Increasing data volumes 1 Real- time data 2 Non-Relational Data New data sources & types 3 Cloud-born data 4
Data sources Non-Relational Data The Modern Data Warehouse
Demo Combining Structured and Semistructured Data with SQL Server PDW and Polybase
Demo Combining Structured and Semistructured Data with SQL Server PDW and Polybase And remember, it’s not just working with Twitter data
SQL Server PDW APPLICATIONS DATA SYSTEMS Microsoft Applications DATA SOURCES Traditional Sources (RDBMS, OLTP, OLAP) New Sources (web logs, email, sensor data, social media) HDInsight Polybase Feature in SQL PDW CREATE TABLE Customers ([user_id] INT, name NVARCHAR(50)… CREATE EXTERNAL TABLE ClickEvent ( url varchar(50 ), event_date date, user_ID varchar(50 ) ) WITH LOCATION = ‘hdfs://MyHadoop:5000/clickstream/click.txt’; SELECT COUNT(*) FROM Customers c JOIN ClickEvent e ON c.[user_ID] = e.[user_ID] WHERE c.Name = 'Jones'; Socket for Big Data: Hadoop Access Made Simple
Simplicity & Manageability Broaden accessibility of Big Data Analytics to all users Combine internal and external data Develop once, deploy on- premises or in the cloud Pillars of Microsoft’s Big Data Strategy
Data Platform market is estimated to grow 9% YoY Business Intelligence market growing 16.4% YoY Data Warehousing growing 13.5% YoY Big Data market estimated to grow 39.4% YoY Source: IDC Whats in it for you as Partner?
Leverage pre-engineered Data Warehouse and Hadoop Appliance solutions from Microsoft (and it’s hardware partners) De-risk your projects Streamline deployments Modernize your customers Data Warehouse/BI Environments >> Make them Big Data Ready! Leverage and connect the cloud Streamline deployments Decommission fast if smaller hadoop (HDInsight) cluster is sufficient Whats in it for you as Partner?
SQL Server Parallel Data Warehouse (PDW) Landing Page: www.microsoft.com/PDW Microsoft Big Data Landing Page: www.microsoft.com/bigdata Introduction to Polybase: http://www.microsoft.com/en-us/sqlserver/solutions-technologies/data- warehousing/polybase.aspx http://www.microsoft.com/en-us/sqlserver/solutions-technologies/data- warehousing/polybase.aspx Twitter Analytics for Excel: http://extendedresults.com/products/twitteranalytics/ Additional Resources