99s_First_Production_Server.jpg CC-BY : 10x 4Gb Hard Drives 2000: 5000 Linux PCs Today: > 2 billion servers (estimated) “I don't think the web would exist without open source and Linux. So there would have been no Google.” — Chris DiBona, Google

New York Times, June (3 hours after Michael Jackson’s death)

R ≃ Stata Across all fields In economics, Stata dominates (not shown)

Rexer Data Miner Survey IEEE Spectrum, July 2014 #9: R Language Popularity IEEE Spectrum Top Programming Languages

BIG DATA

HINDSIGHT INSIGHT FORESIGHT What happened? Why did it happen? What will happen? How can we make it happen? Traditional BIAdvanced Analytics INFORMATION OPTIMIZATION

Drew Conway science-venn-diagram/ Data Integration Mashups Applications Models Visualization Predictions Uncertainty Problems Data Sources Credibility Effective Data Applications

ETL Marketing channel data Behavioral variables Promotional data Overlay data Exploratory data analysis Time-to-event models GAM survival models Scoring for inference Scoring for prediction 5 billion scores per day per retailer CUSTOM DATA FORMAT CUSTOM VARIABLES (PMML)

Exposing the expertise of data scientists as APIs Bringing the utility of data science to applications Addressing the Data Science talent gap

Azure: Huge infrastructure scale 19 Regions ONLINE…huge datacenter capacity around the world…and we’re growing  100+ datacenters  One of the top 3 networks in the world (coverage, speed, connections)  2 x AWS and 6x Google number of offered regions  G Series – Largest VM available in the market – 32 cores, 448GB Ram, SSD… Operational Announced Central US Iowa West US California North Europe Ireland East US Virginia East US 2 Virginia US Gov Virginia North Central US Illinois US Gov Iowa South Central US Texas Brazil South Sao Paulo West Europe Netherlands China North * Beijing China South * Shanghai Japan East Saitama Japan West Osaka India West TBD India East TBD East Asia Hong Kong SE Asia Singapore Australia West Melbourne Australia East Sydney * Operated by 21Vianet

Data Scientist Interact directly with data Built-in to SQL Server Data Developer/DBA Manage data and analytics together SQL Server 2016 Built-in in-database analytics Example Solutions Fraud detection Sales forecasting Warehouse efficiency Predictive maintenance Relational Data Analytic Library T-SQL Interface Extensibility ? R R Integration Microsoft Azure Machine Learning Marketplace New R scripts

rows minutes R on a server pulling data via SQL R on a server Invoking RRE ScaleR Inside the EDW