Armando Lacerda alacerda@designmind.com.

Slides:



Advertisements
Similar presentations
1Key – Report Creation with DB2. DB2 Databases Create Domain for DB2 Test Demo.
Advertisements

Microsoft Big Data Essentials Module 1 - Introduction to Big Data
Chapter 3 Files/Folders needed: \Chapter3\Samples \Chapter3\Labs.
Enterprise Application Integration using Microsoft’s integration stack
Andy Roberts Data Architect
Power BI for Developers Rui Romano.   BI Pro / Soft. Architect / Developer  Blog 
SQLSaturday Paris 2015 Power BI for Developers Rui Romano.
Power BI for Developers Rui Romano SQLSaturday.com
Real-Time Dashboards on Power BI
Microsoft Ignite /28/2017 6:07 PM
DBM 384 Week 2 DQ 1 Check this A+ tutorial guideline at 384/DBM-384-Week-2-DQ-1 Explain how Structured Query Language.
It’s time to refresh your data in Power BI!
Why are you still taking backups?
Introduction to Spark Streaming for Real Time data analysis
Enterprise Row Level Security: SQL Server 2016 and Azure SQL DB
Make Power BI Your Own with the Power BI APIs
10 Amazing Things About Power BI You Don’t Know
Welcome! Power BI User Group (PUG)
Real Time Data with Azure and Power BI
Data-driven serverless apps with Azure functions
Data-driven serverless apps with Azure functions
Using a Gateway to Leverage On-Premises data in Power BI
Make Power BI Your Own with the Power BI APIs
A time travel with temporal tables
Example of a page header
A time travel With temporal tables Leonel Abreu
Example of a page header
Power BI Security Best Practices
Mission-critical performance with Microsoft SQL Server 2016
Victoria Power BI User Group Meeting
Qualitative Text Analysis
Make Power BI Your Own with the Power BI APIs
Using Microsoft Flow with Power BI
Database migrated to Azure SQL DB. Checked.
Real-Time streaming in Power BI
Josh Burgin Real-time Smart Home Analytics March 17, 2018
Microsoft Azure for SQL Server Professionals
Overview of Security Investments
Armando Lacerda
Business Intelligence Fundamentals: SQL Server Analysis Services
20 Questions with Azure SQL Data Warehouse
Make Power BI Your Own with the Power BI APIs
Power Saturday.
Power BI for large databases
Microsoft Azure for SQL Server Professionals
Enterprise RLS in SQL Server in Power BI
Stretch Database - Historical data storage in SQL Server 2016
What query folding means to self-service BI projects
Data Modeling and Prototyping
Unleashing Stretched Databases
CSG, Power BI & Embedded.
Go, go Query Store! Gail Shaw.
Introduction into the Power BI REST API Jan Pieter Posthuma
Power BI with Analysis Services
CS122B: Projects in Databases and Web Applications Winter 2019
Microsoft Azure for SQL Server Professionals
CS122B: Projects in Databases and Web Applications Spring 2018
Armando Lacerda
Power BI at Enterprise-Scale
Armando Lacerda
Power BI – Introduction to Dataflows
CS122B: Projects in Databases and Web Applications Winter 2018
Dashboard in an Hour Using Power BI
Bob Duffy 27 years in database sector, 250+ projects
Database SQL.
Tools and techniques for managing big data with Power BI
Power BI + R Visuals Made Easy for Medical Cross Review
Embedding Power BI in your application
Data Modeling and Prototyping
Power BI Embedded for Fun and Profit
Presentation transcript:

Armando Lacerda alacerda@designmind.com

Agenda Live data in Power BI Limits Lambda Architecture Armando Lacerda me@armandolacerda.com Live data in Power BI Limits Lambda Architecture Do it in SQL Server Do it in Cosmos DB Import Pro 8 times / day Premium 48 times / day

Import Pro 8 times / day Premium 48 times / day Direct Query

Direct Query Import

Stream Push | Streaming | PubNub Direct Query Import

Demo Armando Lacerda me@armandolacerda.com

Limits of power bi live stream https://msdn.microsoft.com/en-us/library/dn950053.aspx 75 max columns 75 max tables 10,000 max rows per single POST rows request 1,000,000 rows added per hour per dataset 5 max pending POST rows requests per dataset 120 POST rows requests per minute per dataset If table has 250,000 or more rows, 120 POST rows requests per hour per dataset 200,000 max rows stored per table in FIFO dataset 5,000,000 max rows stored per table in ‘none retention policy’ dataset

Limits of power bi live stream https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming 75 max columns 75 max tables 10,000 max rows per single POST rows request 1,000,000 rows added per hour per dataset 5 max pending POST rows requests per dataset 120 POST rows requests per minute per dataset If table has 250,000 or more rows, 120 POST rows requests per hour per dataset 200,000 max rows stored per table in FIFO dataset 5,000,000 max rows stored per table in ‘none retention policy’ dataset

Lambda architecture DATA Query Data Sink Data Service Batch Processing Discrete processing

Lambda architecture DATA Query Data Sink Data Service Batch Processing Data Queue Data Service Discrete processing

Lambda architecture DATA Query Batch Processing Data Service Data Sink Data Queue Data Service Discrete processing

Lambda architecture DATA Query Data Service Data Sink Batch Processing Data Queue Discrete processing Data Service

Lambda architecture DATA Query Data Sink Batch Processing Data Service Data Queue Data Service Discrete processing

Lambda architecture Temporal Tables In Memory Tables DATA QUERY Data Sink Batch Processing Data Service DATA QUERY Data Queue Data Service Discrete processing

In Memory Tables Lambda architecture

Do it with cosmos db

Do it with azure sql db

Do it with azure sql db

Do it with azure sql db Demo