BUILD BIG DATA ENTERPRISE SOLUTIONS FASTER ON AZURE HDINSIGHT

Slides:



Advertisements
Similar presentations
Observation Pattern Theory Hypothesis What will happen? How can we make it happen? Predictive Analytics Prescriptive Analytics What happened? Why.
Advertisements

Breaking points of traditional approach What if you could handle big data?
Business Intelligence for everyone 2 For BI to deliver maximum value, all Information Workers must participate: Broad access to uncover and share insights.
Microsoft Cognitive Services and Cortana Analytics
A Suite of Products that allow you to Predict Outcomes, Prescribe Actions and Automate Decisions.
The Derivitec Risk Portal Provides Powerful, Cost-Effective Risk Management Solutions, Powered by Azure, that Deploy in Minutes MICROSOFT AZURE ISV PROFILE:
Business Insights Play briefing deck.
Energy Management Solution
Big Data from Microsoft Azure Robert Turnage Data Solutions Architect
11/7/2017 2:56 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Connected Infrastructure
Run Azure Services in your datacenter
AuraPortal Cloud Helps Empower Organizations to Organize and Control Their Business Processes via Applications on the Microsoft Azure Cloud Platform MICROSOFT.
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Breeding Data Scientists
Enterprise grade security in your Hadoop clusters on Azure
4/18/2018 6:56 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Cortana Intelligence Suite Workshop
5/7/ :44 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Connected Living Connected Living What to look for Architecture
Smart Building Solution
Examine information management in Cortana Intelligence
Cortana Intelligence Overview
Creating Enterprise Grade BI Models with Azure Analysis Services
Orchestrating Data and Services with Azure Data Factory
Machine Learning in practice
Enable the Hybrid Data Platform
Smart Building Solution
Connected Living Connected Living What to look for Architecture
Microsoft Build /22/ :52 PM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,
Wonderware Online Cost-Effective SaaS Solution Powered by the Microsoft Azure Cloud Platform Delivers Industrial Insights to Users and OEMs MICROSOFT AZURE.
Connected Infrastructure
Energy Management Solution
9/13/2018 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Add intelligence to Dynamics AX with Cortana Intelligence suite
Cloudy with a Chance of Data
NGAGE Intelligence Leverages Microsoft Azure Platform to Provide Essential Analytics for Hybrid SharePoint Server/Office 365 Environments MICROSOFT AZURE.
Azure Infrastructure as a Service
9/21/2018 3:41 AM BRK3180 Architect your big data solutions with SQL Data Warehouse & Azure Analysis Services Josh Caplan & Matt Usher Program Managers.
Enterprise security for big data solutions on Azure HDInsight
Turning back time … … to 1998.
Azure Data Catalog Adoption Patterns and Best Practices
Welcome! Power BI User Group (PUG)
Overview of Azure Data Lake Store
Oscar AP by Massive Analytic: A Precognitive Analytics Platform for Effortless Data-Driven Decisions. Now Available in Azure Marketplace MICROSOFT AZURE.
Designed for Big Data Visual Analytics, Zoomdata Allows Business Users to Quickly Connect, Stream, and Visualize Data in the Microsoft Azure Platform MICROSOFT.
Yellowfin: An Azure-Compatible Business Intelligence Platform That Connects People with Their Data for Better Decision Making MICROSOFT AZURE APP BUILDER.
Logsign All-In-One Security Information and Event Management (SIEM) Solution Built on Azure Improves Security & Business Continuity MICROSOFT AZURE APP.
Dive into Predictive Maintenance using Cortana Intelligence Suite
Utilizing the Capabilities of Microsoft Azure, Skipper Offers a Results-Based Platform That Helps Digital Advertisers with the Marketing of Their Mobile.
Through the Microsoft Azure Platform, TARGIT Decision Suite Enables Organizations to Analyze Critical Data, Giving Them the Courage to Act MICROSOFT AZURE.
Microsoft Connect /22/2018 9:50 PM
DeFacto Planning on the Powerful Microsoft Azure Platform Puts the Power of Intelligent and Timely Planning at Any Business Manager’s Fingertips Partner.
Data Security for Microsoft Azure
Welcome! Power BI User Group (PUG)
Modern cloud PaaS for mobile apps, web sites, API's and business logic apps
XtremeData on the Microsoft Azure Cloud Platform:
Azure Enables Mobility, Easy Sync and Share, and Allows Companies to Retain Data Control MINI-CASE STUDY “Azure provides the full stack of technology that.
Databricks: the new kid on the block
Analytics in the Cloud using Microsoft Azure
Last.Backend is a Continuous Delivery Platform for Developers and Dev Teams, Allowing Them to Manage and Deploy Applications Easier and Faster MICROSOFT.
Azure Machine Learning on Databricks
*AZs available across US, Europe and Asia
Built on the Powerful Azure Platform, Angoss Helps Businesses Turn Data into Actionable Insights That Reduce Risk, Increase Organizational Performance.
Introduction to Azure Data Lake
Productive + Hybrid + Intelligent + Trusted
Customer 360.
SQL Server 2019 Bringing Apache Spark to SQL Server
Architecture of modern data warehouse
Presentation transcript:

BUILD BIG DATA ENTERPRISE SOLUTIONS FASTER ON AZURE HDINSIGHT Pranav Rastogi Microsoft @rustd

Agenda Azure HDInsight Overview HDInsight Application Platform Big data solutions

Big data is hard Success Buy Servers Install OSS Secure Configure Optimize Debug Scale up

HDInsight makes it easy 100% open source Optimized Highly available Secure Scalable Dedicated Managed Certified ISVs Customizable Browse to Azure Portal Provide Cluster details HDInsight Cluster

Open Source for the Enterprise Microsoft Build 2017 12/9/2017 11:20 PM Open Source for the Enterprise Managed Open Source Analytics for the cloud with a 99.9% SLA. 100% Open Source Clusters up and running in minutes 63% lower TCO than deploy your own Hadoop on-premises Separation of compute and store allows you to scale clusters to exponentially reduce costs © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Deploy Globally Within Minutes Microsoft Build 2017 12/9/2017 11:20 PM Deploy Globally Within Minutes Multi Region Availability Available in >25 regions world-wide Launched most recently in US West 2, and UK regions Available in China, Europe and US Government clouds © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Security and Compliance to Enable OSS for Enterprises Microsoft Build 2017 12/9/2017 11:20 PM Security and Compliance to Enable OSS for Enterprises Authentication Azure Active Directory Kerberos authentication Perimeter Level Security Virtual Networks Network Security Groups (firewalls) Authorization Apache Ranger RBAC for Admin POSIX ACLs for Data Plane Data Security Server-Side encryption at rest HTTPS/TLS In-transit © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Rich Developer Ecosystem Microsoft Build 2017 12/9/2017 11:20 PM Rich Developer Ecosystem Plugins for HDI available for most popular IDEs for agile development and debugging Rich support for powerful notebooks used by data scientists Develop in C#, deploy on Linux in Java via HDI developed SCP.Net technology © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Recognized by Top Analysts Forrester Wave for Big Data Hadoop Cloud Named industry leader by Forrester with the most comprehensive, scalable, and integrated platforms* Recognized for its cloud-first strategy that is paying off* *The Forrester WaveTM: Big Data Hadoop Cloud Solutions, Q2 2016.

HDInsight Application Platform 1-click deploy experience for apps

HDInsight Application Platform Discover and install apps from ecosystem One-click deploy experience Access to entire cluster and secure by default  Install apps on new or existing clusters  Ease of authoring and deployment for ISV’s

HDInsight architecture Gateway nodes Head Worker Edge Zookeeper nodes Hive meta store Azure SQL database Azure Storage or Data Lake Store Client machines HDInsight cluster

StreamSets – Conquer dataflow chaos

Why StreamSets Data Movement from disparate sources KPI’s on data transfer Manage Data drift (unexpected changes) at scale. Run at enterprise grade & scale on HDInsight

Deep Integration with Microsoft Azure STREAMSETS DATA COLLECTOR Deep Integration with Microsoft Azure Information Management Big Data Stores Machine Learning and Analytics Intelligence Data Sources People * Machine Learning Cognitive Services Data Lake Store Data Lake Store SQL Data Warehouse Data Lake Analytics Bot Framework Apps Web Mobile Bots Data Catalog Apps * HDInsight (Hadoop and Spark) Event Hubs Cortana * Kafka for HDInsight Stream Analytics Dashboards & Visualizations Sensors and devices * Automated Systems Power BI Intelligence Data Action *

Datameer: Self-Service Data prep/ analytics

Why Datameer Self-service data prep/ analytics for non - Hadoop users No Hadoop expertise required Ease to use excel-like interface for analysts Run at enterprise grade & scale on HDInsight

AtScale (OLAP on Hadoop) No data movement

Why AtScale No data movement for BI scenarios Use any BI tool Scale out OLAP with Hadoop & Spark No Hadoop/ Spark expertise required Target audience: Analysts Run at enterprise grade & scale on HDInsight

Dataiku – Data science at Enterprise grade scale

Why Dataiku Collaborative data science experience Single tool for data scientists/ beginner analyst data ingestion (all data types, sizes, format etc.), data preparation, data processing, machine learning, visualization and operationalizing the solution. Run at enterprise grade & scale on HDInsight

H2O.ai– Deep learning at Enterprise grade scale

Why Open Source deep learning platform Run at enterprise grade & scale on HDInsight

Cask – Unified Platform for Big data

Enabling Customers’ Journey from Data Ingestion to Action Cask and Microsoft: Enabling Customers’ Journey from Data Ingestion to Action Ingest, explore & serve data Enable governed self-service Capture, track and analyze (meta)data Develop, test, debug & deploy apps Information Management Event Hubs Data Catalog Data Factory Big Data Stores Machine Learning and Analytics Intelligence Dashboards & Visualizations Cortana Bot Framework Cognitive Services Power BI Data Sources People Machine Learning Data Lake Store SQL Data Warehouse Data Lake Analytics Apps Web Mobile Bots Apps HDInsight (Hadoop and Spark) Stream Analytics Sensors and devices Automated Systems Data Intelligence Action

Azure HDInsight Big Data made easy Analytics on any data, any size Easier and more productive for all users Enterprise-ready

Resources Azure HDInsight application platform Install custom HDInsight applications Try SDC from StreamSets on HDInsight Try Datameer on HDInsight Try AtScale on HDInsight Try DSS from Dataiku on HDInsight Try H2O.ai on HDInsight Try CDAP from Cask on HDInsight

Thank You Pranav Rastogi Microsoft @rustd