Presentation is loading. Please wait.

Presentation is loading. Please wait.

Internal Modern Data Platform Somnath Data Platform Architect.

Similar presentations


Presentation on theme: "Internal Modern Data Platform Somnath Data Platform Architect."— Presentation transcript:

1 Internal Modern Data Platform Somnath Data Platform Architect

2 Tweet Sentiment Analysis  Cloud service which is using the Twitter Streaming API to monitor specific hashtags (e.g. #DataZen, #HoloLens, #msbirocks, #mspowerbi, and #PowerBI). This cloud service uses Azure ML to analyze twitter sentiment.  The cloud service sends analyzed/filtered tweets to an event hub, and it is using Azure ML to calculate its sentiment score.  Azure Stream Analytics aggregates the tweets and sentiment data received from the event hub and sends the aggregated data to a Power BI dashboard in real-time.

3 Desktop files Spreadsheets Server stores Sensors ML Studio API M Marketplace

4 SaaS Data Sources Power BI web browser With natural language query, visual exploration etc. Power BI Architecture – PBI Desktop, Power BI & Power BI Personal Gateway Azure-resident systems Azure Stream Analytics Azure SQL/DW HDInsight Power BI Mobile Apps with dashboards, alerting and visual exploration Bring your data….. …to life AS Tabular Corporate Data Sources PBI Desktop Power BI AS Connector Excel On-premise systems / other Real time Dashboards using Push API or ASA Power BI Personal Gateway

5 Data sources Power BI service SaaS solutions e.g. Marketo, Salesforce, GitHub, Google analytics On-premises data e.g. Analysis Services Organizational content packs Corporate data sources or external data services Azure services Azure SQL, Stream Analytics… Excel files Workbook data / data models Power BI Desktop files Data from files, databases, Azure, and other sources Data refreshVisualizations Live dashboards Content packs Sharing & collaboration Natural language query Reports Datasets 01001 10101 Power Data Sources Power BI REST APIsPower BI Desktop Prepare ExploreShareReport

6 Power BI connects to a variety of data sources. These range across both cloud and on-premises sources, and include: A variety of popular SaaS solutions, such as Marketo, Salesforce, GitHub, Dynamics CRM, Zendesk, and several others On-premises databases – Power BI offers live connectivity to SQL Server Analysis Services, Azure SQL. And using a gateway solution, Power BI can connect to other database solutions such as Oracle and others. Custom data sources – Power BI can connect to any data source you need it to thanks to its extensibility via REST APIs. This includes both proprietary corporate data sources, as well as external data services. For example, if you are a SaaS solution provider, you can work with Microsoft to connect your solution to Power BI. For example: Sales Force or Marketo. Other Azure services – Power BI integrates tightly with SQL Azure and Stream Analytics, and will be integrating closely with more Azure services over time Power BI Desktop and Excel files – Excel workbooks can be directly connected to Power BI.com, or may be used with Power BI Desktop. Power BI Desktop is a companion application to the Power BI service – it is a desktop tool that supports data analysis and reporting. Like Excel files, Power BI Desktop files may be uploaded to the Power BI service. Power Data Sources

7 Feature SaaS solutions e.g. Marketo, Salesforce, GitHub, Google Analytics On-premises Data Data sources Organizational Corporate data sources or external data services Azure services Azure SQL, Stream Analytics… Power BI Desktop files Data from files, databases, Azure, and other sources Excel files Consume structured/unstructured data using other Azure services HDInsight Storage Event Hubs Machine Learning SQL Server Stream Analytics Power BI

8 Feature  Use Query functionality to connect to data from a variety of sources beyond those available from powerbi.com  Navigate data quickly with in-memory processing that optimizes performance  Pare down datasets to only what’s needed by editing queries before data loading Data sources available through Power BI Desktop Share & collaborate Report Explore Prepare Consolidate data from a broad range of sources FileDatabaseAzureSaaSOther Excel CSV XML Text JSON Folder SQL Server Database Access Database SQL Server Analysis Services Database Oracle Database IBM DB2 Database MySQL Database PostgreSQL Database Sybase Database Teradata Database Microsoft Azure SQL Database Microsoft Azure Marketplace Microsoft Azure HDInsight Microsoft Azure Blob Storage Microsoft Azure Table Storage appFigures QuickBooks Online Zendesk GitHub Twilio SweetIQ Web SharePoint List OData Feed Hadoop File (HDFS) Active Directory Microsoft Exchange Dynamics CRM Online Facebook Google Analytics SAP Business Objects BI Universe Salesforce Objects Salesforce Reports ODBC Query ODBC Tables Power BI Desktop

9 Feature Keep all your data current  Real-time dashboards o using the Power BI REST API or o with built-in Azure Stream Analytics integration  Live connectivity – With MS DB products o data is updated as user interacts with dashboard or report o to existing on-premise sources, e.g. Analysis Services, with auto-refresh o to Azure SQL Database with auto- refresh  Automatic or scheduled refreshes o regardless of where data lives o SaaS data sources (automatic) o Schedule refreshes for on-premise data sources with Personal Gateway Data refresh architecture Live query Popular SaaS Solutions Live dashboards and reports Dynamics Marketing Power BI SQL Server Analysis Services (SSAS) Secure Credential Store Content packs Dashboards Reports Datasets Visualizations Mobile Q&A Collaboration Easy signup Data refresh Power BI Service

10 Feature More about Power BI Personal Gateway  Power BI Personal Gateway is required in order to refresh datasets that get data from a supported on-premises data source in your organization Supported on-premise data sources: SQL Server Oracle Teradata IBM DB2 PostgreSQL Sybase MySQL SharePoint List (on-premises) File (CSV, XML, Text, Excel, Access) On-premises SQL Server Analysis Services Tabular models (uploaded data; not live connections) Folder Custom SQL/native SQL Content packs Dashboards Reports Datasets Visualizations Mobile Q&A Collaboration Easy signup Data refresh Power BI Service

11 Access on-premises data any way you like: Scheduled refresh Live connection Connect to on-premises SQL Server Analysis Services models: Tabular and multidimensional Cloud On-premises

12 Cloud On-premises Keep data in Power BI up to date using scheduled refresh Anyone can refresh – no IT dependency Support for a large number of data sources Easy to use with a desktop- based lightweight one-click installer

13 Cloud On-premises Centralized way to refresh on-premises data in Power BI Control access to data sources Monitor gateways and data sources Live, interactive query with on-premises data sources  COMING SOON

14 Data Platform Roadmap – Drives (Data patterns) 14 Data Factory StorSimple Storage Polybase Power BI Data classification Power BI Power view Visualization and reporting tools Improve access to business data Improve operational management Reduce costs Value IT Projects Azure ML/Revo R Big Data Stream Advanced Analytics and Modelling solutions Power BI Improve analytical results Improve quality of decisions Perform wider variety of analysis Business Benefits Improve business management Increased agility in responding to business Improve regulatory compliance Time Expand data types and volume Support larger data sets Support less structured data Batch processing of data Reporting with descriptive analytics Improved access to operational data Batch processing of data Analytic results supporting operations Real-time analytics Big Data Predictive modelling Real-time streaming data collection and analysis Pervasive analytics and BI throughout organization SQL Server 2014/2016, Oracle Enhanced SSIS, other tools Built-in Advanced Analytics – ‘R’ SQL Azure Hybrid Architecture New Performance upgrades Security, HA, Scalability, Access any Data Reduce costs Enterprise SQL Server Consolidation Improved access to Mission Critical OLTP applications Deeper Insights Across Data HyperScale Cloud – Hybrid Solutions

15 Internal Thank you


Download ppt "Internal Modern Data Platform Somnath Data Platform Architect."

Similar presentations


Ads by Google