1. Power BI- best practices
Power BI- best practices
@SQLMaster
Configuration and Deployment best practices to deliver just in-time insights
Satya Jayanty

2. About me : Satya Jayanty
IT Experience
Been in the IT field over 24+ years (using SQL Server ver.4.2 onwards)
Principal Architect – D Bi A Solutions, Europe
10 years as Microsoft MVP (Windows – SQL Architecture)
Community Contributions
Speaker : Microsoft Tech-Ed (North America/India/Europe), SQLPASS, SQLSaturdays SQL Bits, User Groups (Scottish Area SQL Server & Nottingham)
‘Ask The Experts’ Lounge: Microsoft Tech-Ed, HeroesHappnHere & SQLPASS
SME & Technical Reviewer for SQL Server & 2012 certification papers.
Publications
Founder (SQLMaster) & blogs at (Knowledge Sharing Network)
Author: SQL Server 2008 R2 Administration cookbook & SQL Server Analysis Services 2012 Cube Security Instant
Co-Author: MVP Deep Dives Volume II. Technical Reviewer: SQL Server books from Packt Publishers.
Active participation in assorted forums such as SSP, SQL Server Central, MSDN, SQL Server magazine, dbforums etc.

3. Thanks to our Main Sponsors:

4. Say Thank you to Volunteers:
They spend their FREE time to give you this event.
Because they are crazy. 
Because they want YOU to learn from the BEST IN THE WORLD.

5. Session Goals Power BI possibilities & available tools
How to deploy Power BI, configuration parameters & package BI features
Power BI from Office 365 rollout
How to manage & connect on premise data to cloud capabilities
Build an E2E sample using Power BI
Create, sharing, consuming and refresh
5 |
@sqlmaster

6. BI solution scenarios Operational Reporting
Microsoft BI Voyage
BI solution scenarios
Operational Reporting
Access to existing data from operational systems
Business Process / Activity Management
Analysis and reporting capabilities for specific business processes or activities
Data Mart / Integrated Reporting and Analytics
Tools and access to business users of an application. to enhance its value by improving decision making
Enterprise Data Warehousing / Information Management
Comprehensive integration of critical information across the enterprise. Breaks down the barriers between applications.
Since the goal of building a business intelligence solution is to drive better decision making, there is no single solution scenario to describe what a BI Solution looks like.
There are however some broad categories of solutions that describe common approaches to BI solutions that are defined on this slide. These solutions range from low complexity / small investment (Operational Reporting) up to high complexity / large investment (Enterprise Data Warehousing)
Building a data mart means providing improved access and tools to business users of your application data at all levels of the organization (executives, analysts, information workers, front-line workers), allowing your customer to better leverage the data assets contained in your application.
By understanding this solution scenario, you can decide how to approach building your first BI solution. Some developers may elect to start small by simply providing improved access to operational data as described in the Operational Reporting scenario. Other developers may decide to tackle the larger problem of providing comprehensive integrated reporting and analytics capabilities to their application as described in the Data Mart scenario. Truly adventurous developers may decide to tackle the larger problem of Enterprise Data Warehousing, and attempt to provide their customer with an Enterprise Information Management solution which solves the larger problem of providing an integrated view of enterprise information across application boundaries.
Microsoft Developer & Platform Evangelism

7. Self-Service Business Intelligence
What Do Users want to Do?
Access
Clean
Mash-up
Explore
Visualize
Share

8. Self-Service Business Intelligence in Excel 2013
Excel 2013: Complete and Powerful Self-Service BI Tool
Access
Clean
Mash-up
Explore
Visualize
Share
Power BI for Office 365 is an umbrella name for many technologies and tools that blend well together. It is a self-service Business Intelligence solution with the ultimate goal of providing deeper business insights from your data.
Excel is the "center of the universe" for all these tools, and works in combination with SharePoint Online.
Data steward
Report creator
Report consumer

9. Power BI (in Excel) Power Query Query data Clean data
Power Pivot
Model tables
View in Pivot Tables / Charts
Power View / Power Map
“Prettier” visualizations
Can map
Visualize
Model & Analyze
Discover & Combine

10. 4/27/2017 9:19 PM
Power BI for Office 365
An end-to-end Self-Service BI solution delivering just-in-time insights to your organization.
Consumption (Web & Mobile)
Authoring (Excel)
Management (Web & Excel)
BI Sites in Office 365: Find insights quickly by using BI sites to view reports, share & collaborate with colleagues. View large workbooks & stay current with data refresh.
Mobile BI: Stay connected with mobile access to your favorite live and interactive reports, from anywhere, on any device.
Power Q&A: Ask questions in natural language and get immediate answers in the form of interactive charts and graphs.
Power Query: Discover, import, reshape and combine data to meet your analysis needs. Share queries into the Data Catalog.
Power Pivot: Lightning fast analytics with xVelocity in- memory BI engine technology. Define measures, hierarchies, and KPI’s.
Power View: Bring your data to life with interactive visualization.
Power Map: Explore geospatial data in new ways to discover hidden insights.
IT Pro: Manage your Power BI service, users and data sources. Enable refresh and access to your data sources from the Cloud using a Data Gateway and discoverability from Excel with the Data Catalog.
Data Stewardship: Manage and share your own data views and definitions into your enterprise Data Catalog. Certify and grant access to these queries. Monitor usage. “
Scalable | Manageable | Trusted
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. Power BI – Conceptual Architecture
Index
O365 Power BI
Public Cloud Data Sources
Data Refresh
Public
Data Catalog
Cloud Data Sources
Corporate
Data Catalog
Power BI Admin Center
Data Management Portal
SPO team sites, BI Sites, Q&A
Import Data
Import Data
Data Refresh
Consume interactive reports, ask questions
Import data,
Publish queries
Publish reports & create featured questions, configure scheduled refresh
Publish queries
Data Management Gateway
Publish raw data sources or expose them as OData feeds
Configure
Manage Data
Power Query
Power Pivot
Power View
Power Map
Excel,
Tablet/Mobile,
Browser – Silverlight, HTML5
Corporate Data Sources
IT Admin
Data Steward IW
(Author) IW
(Consumer)
Import Data
Import Data
@sqlmaster

12. www.sqlserver-qa.net @sqlmaster
Getting Started
Showcase
Power BI Signup
@sqlmaster

13. Power BI for Office 365 (Excel) Components
Power Pivot (embedded in Excel 2013) – need to be enabled
Power View (embedded in Excel 2013) - need to be enabled
Power Query – need to be downloaded and installed
Power Map – need to be downloaded and installed

14. Power BI for Excel components requirements
The following Office versions are supported:
Office 2013 Professional Plus
Office 365 ProPlus
Inbuilt within Office 2016
Supported Operating System
Windows 7, Windows 8, Windows Server 2008 R2, Windows Server 2012, Windows Vista
Windows Vista (requires .NET 3.5 SP1)
Windows Server 2008 (requires .NET 3.5 SP1)
Windows 7
Windows 8

15. Data Sources Data types are organized in the following categories: All
File
Database
Azure
Other
The Other category provides the following data connections:
Web
SharePoint List
OData Feed
Hadoop File (HDFS)
Active Directory
Microsoft Exchange
Dynamics CRM Online
Facebook
Google Analytics
SAP BusinessObjects BI Universe
Salesforce Objects
Salesforce Reports
ODBC Query
ODBC Tables (Beta)
Blank Query
The All category includes all data connection types from all categories.
The File category provides the following data connections:
Excel
CSV
XML
Text
Folder

16. Data Sources Available system wide Support for SQL Server and Oracle
Users and groups configured through the portal
Static credentials used for refresh
Support for SQL Server and Oracle
More data sources coming soon
Complex Data Feed functionality
Expose SSIS data flow as SQL view

17. Consumption (Web & Mobile)
Consuming a report
BI Sites in Office 365: Find insights quickly by using BI sites to view reports, share & collaborate with colleagues. View larger workbooks & stay current with data refresh.
Mobile BI: Stay connected with mobile access to your favorite live and interactive reports, from anywhere, on any device.
Power Q&A: Ask questions in natural language and get immediate answers in the form of interactive charts and graphs.
Showcase
Get Data

18. Title Goes Here, 36 pt. Data Source Location Auto-Refresh
Data Management Gateway Required
SQL Azure Database
Azure
Yes No
Azure VM running SQL Server
Yes/No[1]
SQL Server (2005 and later)
On-Premises
Oracle (10g and later)
OData feed[2]
Web/On-Premises/Azure
Power Query[3][4]
On-Premises/Azure
18 |
@sqlmaster

19. Data Source Refresh – Current Data Source Limitations
Not Supported Data Sources: Web, SAP BusinessObjects, Active Directory, HDFS, Facebook, Exchange and Current Excel Workbook.
Native Database Queries (custom T-SQL statements) for relational databases are not supported. If you use the PQ Editor to create your query, you’re good to go.
Dynamically generated data source paths cannot be detected yet. This affects function invocations, data source paths generated via string concatenations, etc.
Web API key and OAuth2 are not supported yet.
Previews of new connectors that haven’t become mainstream features yet, such as Salesforce Objects/Reports.

20. Data Source Refresh – Additional Considerations
Power Query connection strings from Power Pivot “Existing Connections” dialog are still not supported. Use Connection String from the Connections dialog in the Excel Data tab.
All data sources in a single Power Query connection must be hosted on the same gateway. You may consider adding more instances to the gateway to solve any scalability problems.
Since Privacy Level is a required setting for Power Query connections, it is mandatory to specify a value for privacy level and to confirm the credential before trying to refresh a data source.
We will apply the following default Privacy Levels:
For SQL Server and Oracle data sources: Organizational. You can update the privacy level afterwards.
For anonymous access data sources: Fixed to Public.
For data sources not used in Power Query connections: The value of this setting will not take effect and it is safe to choose an arbitrary value.
Power Query Connectors that require a 3rd party driver (such as Oracle, DB2, etc.) will need to have the same driver configured in the Data Management Gateway instance.

21. Supported Data Sources & Authentication Types
Supported Authentication Types
SQL Server
Windows, Basic
Oracle
File (CSV, XML, Text, Excel, Access)
Windows
Folder
SharePoint List (Online)
Anonymous
SharePoint List (On-prem)
Anonymous, Windows
OData Feed
Anonymous, Windows, Basic, Key (Data Market)
Azure Marketplace
Key (Data Market)
Azure HDInsight
Key (Azure Account)
Azure Blob Storage
Azure Table Storage
PostgreSQL
Basic
Teradata
Sybase
DB2
MySQL
SQL Azure
Query that is not accessing data sources
 n/a
Supported Power Query Data Sources for Power BI Refresh
21 |
@sqlmaster

22. Data Stewardship (Web & Excel)
Showcase
O365 Admin Center
Data Stewardship: Manage and share your own data views and definitions into your enterprise Data Catalog. Certify and grant access to these queries. Monitor usage.

23. Role of the IT Admin in Power BI
Enabler of Self Service BI
Varying levels of control across data sources, departments
Oversight and monitoring of cloud data access
Ability to make corporate data sources easier to discover, and easier to access

24. Power BI Admin Center Access via link in O365 admin portal
Configure Power BI roles
Install and monitor the Data Management Gateways for your organization
Configure access to cloud enabled data sources
Expose OData feeds to corporate data sources

25. Data Management Gateway
Connect your on premise servers with Power BI in the cloud. 
Refresh your data  in the cloud with data that is on premise
Configure Data Management Gateway and available for your tenant.
capabilities
Data Management Gateway
Power BI Admin Center
The Data Management Gateway is needed to connect your on premise servers with Power BI in the cloud.  If you want to refresh your data  in the cloud with data that is on premise, you will need to have the Data Management Gateway configured and available for your tenant.
Enabling Corporate OData Feeds
Enabling Discovery in Power Query
Enabling Excel Workbook Data Refresh using SharePoint Online
@sqlmaster

26. Data Management Gateway - Conceptual
Connects to corporate data sources and sends data to Microsoft cloud services through a secure channel (Service Bus).
Secure Credential Store
All credentials used by the gateway are stored on-premises. Encrypted backup of credentials can also be stored in the cloud to enable business continuity scenarios.
Power BI Admin Center
Allows IT to configure, manage and monitor access to corporate data sources.
Corporate Data Sources
The Gateway can connect to a variety of data sources.
@sqlmaster

27. Data Management Gateway - OData
Expose SQL tables or views as OData feeds
Requires a primary key or unique index
Automatically registered in the Data Catalogue
Creates a cloud endpoint
Currently only used for discovery and authentication
Actual OData results are served from connection to Gateway
Consumable from Power Query
Org ID authentication, and redirection from cloud to on-premises

28. Corporate OData Feeds Power BI Cloud Services Data Management Gateway
(1) Using Power Query User connects to OData feed
(2) Redirect to gateway
Power Query
Data Management Gateway
(5) Returns OData feed
(3) The Data Management Gateway connects to SQL Server using either Windows account or Database account setup by IT when creating the feed
(4) Returns Result
@sqlmaster

29. Gateway Configuration Details
Communicates with cloud services
Requires outgoing ports ( )
Falls back to 443/80 if the other ports aren’t open
No incoming ports from the internet (messages received via Service Bus)
Receives credentials from ClickOnce application
Serves OData feeds to on-prem clients
Requires incoming port
default: 8050 (and 8051 if HTTP is used)
Recommended to use HTTPS with signed certificate
Must be able to resolve DNS names for data sources

30. Data Refresh from Power BI Sites
(2) Connects to Gateway Cloud Service
Gateway
Cloud Service
Excel Workbook in Sharepoint Online
(8) Returns data to Excel Workbook
Data refresh is triggered from Power BI Sites
(7) Compress, chunk and return the data
(3) Checks whether user is authorized to perform a refresh (4) Sends command (SQL statement, connection string) to on-premise Gateway
Data Management Gateway
(6) Return Results
(5) Sends SQL to SQL Server
@sqlmaster

31. Current Limitations Not all data sources can be refreshed
4/27/2017
Current Limitations
Not all data sources can be refreshed
Cloud: Windows Azure SQL Database, SQL Server (in Azure VM), OData
On-Prem: SQL Server (2005+), Oracle (10g, 11g, and 11gR2)
Power Query support coming soon!
Uses pre-defined credentials
Cloud: Embedded in workbook, or read from SharePoint Secure Store
On-Prem: Configure through the Power BI Admin Center
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

32. Microsoft Analytics Platform
4/27/2017
Consumption Experiences
Data Visualization
Data Analysis
Data Modeling
Data Discovery & ETL
Data Warehouse/Big Data
Excel, SharePoint, SSRS, Power BI, Azure
SSRS, Excel with
Power View/Power Map,
PerformancePoint
Excel, SSAS Data Mining, Azure Machine Learning
Excel with PowerPivot, SSAS, Visual Studio
Power Query, SSIS
SQL, APS, Azure, HDInsight, Hadoop/HDFS
@sqlmaster
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

33. Modern Self-Service BI players
@sqlmaster

34. Data Analysis Expressions (DAX)
Programming language for PowerPivot (SSAS 2012 Tabular)
Simple, clean, powerful, fast, not easy
Tabular requires simpler data modeling for good result
Thinking in DAX is a new attitude
@sqlmaster

35. BI Semantic Model: from personal to corporate BI
@sqlmaster

36. Microsoft BI – Power BI Perspective
MGXFY13
4/27/2017
Microsoft BI – Power BI Perspective
Discover &
Combine
in Excel
Data Catalog
Power Query
Steward Portal
Analyze &
Visualize
in Excel
Power Pivot
Power View
Power Map
So what exactly is What is Power BI?
Power BI for Office 365, a self-service business intelligence (BI) solution delivered through Excel and Office 365 which provides information workers with data analysis and visualization capabilities to identify deeper business insights either on premise or within a trusted cloud environment. With Power BI for Office 365, customers can connect to data in the cloud or extend their existing on premise data sources and systems to quickly build and deploy self-service BI solutions hosted in Microsoft’s enterprise cloud.
Power BI for Office 365 enables customers to do more with their data:
- Analyze and present insights from data in compelling visual formats either on premises or in the cloud from Excel.
- Share reports and data sets online with data that is always kept up to date.
- Ask questions of your data using natural language search and get immediate answers through interactive tables, charts and graphs.
- Access and stay connected to data and reports from your mobile devices wherever you are.
Power BI addresses several fundamental business needs:
Enable self-service BI solutions for everyday business users with the ease of use and familiarity of a tool they already use – Excel. Excel is the most widely-used analytical tool by information workers.
What you’ve seen in the past are large IT managed data warehouses such as MSS with publish layers and oftentime IT owned standard reports off of them. This is a great model for much of the biz, but can really diminish the agility aspect and time to insights. If an end user has an additional question or wants to see more fields on their report, or connect more data, that’s going to go into the requirements hopper, be iterated on and take longer than desired to deliver.
What self service BI enables is that IT warehouse or curated views off the source to be shared out and discovered much more easily and then taken further with the ability to connect to other enterprise data sets and visualize and share in a much easier fashion.
So really that speaks to Power BI being an AND scenario for your BI systems. It is not meant to replace large existing warehouse investments, but extend their functionality.
Enable organizations to extend their existing investments for on premise data warehouses and operational systems as well as cloud-based data sources and Hadoop clusters to create secure and easy-to-use self-service BI solutions that can also monitor employee access and usage.
Enable collaboration, connectivity, scale and governance by offering BI in the cloud through Office 365. Users can easily share their data and analysis with colleagues and access reports wherever they go – on their desktop at work, over the Web at home, and on their mobile device. Manage important data for the team and track usage to see who’s accessing the data and what data sets are most often used.
Collaborate,
Get Insights,
& Access Anywhere
Through Office 365
BI Sites
Q&A
Mobile
@sqlmaster
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

37. Summary
Self-service BI in Excel, Power BI provides the tools you need to find data, shape and filter it how you want, model it, and visualize it.
All users can transform data into insight… as a natural part of their day to day activities… with the tools they already know & love.
As an Admin take advantage of Office 365 & Power BI capabilities to manage your BI arena

38. www.sqlserver-qa.net @sqlmaster
Resources
Getting Stated with Power BI for Office 365
Power BI blog
Introduction to Power BI Admin Center
Power BI Admin Center Help
Restore a Data Management Gateway
Monitor System Health using the System Health OData Feed
Publish SSIS Packages as OData Feed Sources
Supported Data Sources and Data Types
@sqlmaster

39. Thank You!