This document and the information contained herein is confidential and proprietary to Allegient LLC and shall not be duplicated, used or disclosed in whole.

Slides:



Advertisements
Similar presentations
Welcome to the DrivenBI/AT&T Webinar: Revolution in Cloud-Based Analytics The webinar will begin shortly.
Advertisements

Observation Pattern Theory Hypothesis What will happen? How can we make it happen? Predictive Analytics Prescriptive Analytics What happened? Why.
Store CheckoutInventory Management Customer Estimation Store Circulation Analysis and Security Interactive Signage Sales Device Customer Demographics.
Running Hadoop-as-a-Service in the Cloud
INTEGRATION DAY 2015 Sam Vanhoutte Azure Event Hubs, Stream Analytics & Power BI.
Architecting the Internet of Things Darren Hubert M256.
Janet works on the Azure Stream Analytics team, focusing on the service and portal UX. She has been in the data space at Microsoft for 5 years, previously.
Andy Roberts Data Architect
AZ PASS User Group Azure Data Factory Overview Josh Sivey, Solution Partner October
This document and the information contained herein is confidential and proprietary to Allegient LLC and shall not be duplicated, used or disclosed in whole.
Your app Intelligent apps learn and adapt to deliver more powerful experiences.
Microsoft Ignite /28/2017 6:07 PM
Microsoft Build /28/2017 6:34 PM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,
TOUR ,000,000,000 1,000,000, ,000,000 10,000,000 1,000, ,000 10,000 1,000 Transistors Moore’s Law Metcalf‘s Law.
This document and the information contained herein is confidential and proprietary to Allegient LLC and shall not be duplicated, used or disclosed in whole.
Energy Management Solution
Energy Demand Forecasting
Azure Stream Analytics
Connected Infrastructure
4/19/ :02 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Microsoft Ignite /10/ :03 PM
Data Platform and Analytics Foundational Training
Data Platform Modernization
Connected Living Connected Living What to look for Architecture
Data Platform and Analytics Foundational Training
Discovering Computers 2010: Living in a Digital World Chapter 14
Examine information management in Cortana Intelligence
Intro to BI Architecture| Warren Sifre
The story of an IoT solution
Parcel Tracking Solution Parcel Tracking What to look for Architecture
Orchestrating Data and Services with Azure Data Factory
What has Azure to offer to IoT Developers?
Introduction to Big Data
Energy Demand Forecasting
Connected Living Connected Living What to look for Architecture
Microsoft Build /22/ :52 PM © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY,
Julie Strauss Senior Program Manager Microsoft
Azure Streaming Analytics
Connected Infrastructure
Building Analytics At Scale With USQL and C#
Configuration Management with Azure Automation DSC
Stream Analytics Coolest and Exciting
Remote Monitoring solution
Energy Management Solution
AZURE STREAM ANALYTICS & DATA FACTORY
Presented by: Warren Sifre
Microsoft Azure P wer Lunch
Cloudy with a Chance of Data
Introduction to Azure Streaming Analytics
9/21/2018 3:41 AM BRK3180 Architect your big data solutions with SQL Data Warehouse & Azure Analysis Services Josh Caplan & Matt Usher Program Managers.
Melbourne Azure Meetup
Turning back time … … to 1998.
SQL Server BI on Windows Azure Virtual Machines
Real-Time streaming in Power BI
Dive into Predictive Maintenance using Cortana Intelligence Suite
Data Platform Modernization
The Internet of Things (IoT) from the back-end perspective
Near Real Time ETLs with Azure Serverless Architecture
Introduction to Big Data
Power-up NoSQL with Azure Cosmos DB
Introduction to Big Data
Virtual Reality with Azure and Unity
What is this and how can I use it?
What is this and how can I use it?
*AZs available across US, Europe and Asia
Azure Stream Analytics
Introduction to Azure Streaming Analytics
Customer 360.
Introduction to Azure Streaming Analytics
Introduction to Big Data
Presentation transcript:

This document and the information contained herein is confidential and proprietary to Allegient LLC and shall not be duplicated, used or disclosed in whole or in part for any purpose other than review. All trademarks and/or service marks contained within this document are the property of their respective owners. Allegient does not in any way warrant the use of their products and/or services offerings. WHAT IS THIS AND HOW CAN I USE IT?  2015 Allegient. All rights reserved. Warren Sifre

Lead Data Analytics Consultant at Allegient. In the IT Industry since Developed system integration solutions against many different database platforms for various applications across many industries. Passion in Solutions Architecture at both hardware and software levels. Interests in SQL Server, MongoDB, Hadoop, Python/C#/Java/Powershell and Information Security (Hacking)  2013 Allegient. All rights reserved.

What is Streaming Analytics? How it works? Use Cases Configuration and Dependencies SAQL Demo  2015 Allegient. All rights reserved.

 2013 Allegient. All rights reserved.

Real-Time Analytics o Many Steps in between the Source Data and the Visualization/Reporting Output. Environment Scalability o Months/Years of planning is needed to plan out equipment procurement and scale out to meet increasing demand. Resource Cost Management o Ideal configuration would require the purchasing of enough equipment to handle peak performance requirements. Although those peak requirements may only be for a few hours of any given day. Disaster Recovery Strategy o Architecting and maintaining a DR strategy where performance, RTOs, and RPOs are met can be challenging and leave the organization with a lot of underutilized resources.

 2015 Allegient. All rights reserved. WHAT? A way to evaluate data before it has reached its final repository destination. Why? Hours to weeks can be the time it takes for data to be transmitted, received, processed, aggregated, then visualized in the traditional Data Warehouse architecture. Business requirements have changed and the desire to glean insights from this data sooner is now becoming a requirement, not a nice to have.

 2015 Allegient. All rights reserved. Transmit Data Event Hub Queues data for processing Streaming Analytics Job Process and Deliver data to multiple end points Power BI Visualize real-time data stream Azure SQL Store data Data Factory Gather and process data for Predictive Analytics Process Machine Learning Predictive Analytics Processing

 2015 Allegient. All rights reserved.

Transportation o Reduce the need to pull vehicles from service for routine inspections by using sensors to determine when actual anomalies are occurring. Energy o Monitor equipment from central locations such as Wind Turbines and Power Generators, thus reducing time spent on manual/physical inspection or replacement of parts just because of time instead of actual degraded performance. Manufacturing o Monitor equipment and plant conditions for optimal performance. Medical Device o Through remote monitoring expensive replacement parts can be order closer to the end-of-life of an equipment than by a schedule. This can reduce the cost of having an overstock of parts on-hand

 2015 Allegient. All rights reserved. Add Input(s) o Data Stream Event Hub Blob Storage IoT Hub o Reference Data Blob Storage Add Output(s) o SQL Database o Blob Storage o Event Hub o Power BI o Table Storage o Service Bus Queue o Service Bus Topic o DocumentDB Add Query o Streaming Analytic Query Language (SAQL) - Similar to T- SQL Scale/Exception o Scale – How much processing power desired for SA Job? o Exception Handling– What is the definition of Late Data? What to do with late or out of order data? o Alerts – When do you want to receive a notification?

 2015 Allegient. All rights reserved. DML SELECT FROM WHERE GROUP BY HAVING CASE WHEN THEN ELSE INNER/LEFT OUTER JOIN UNION CROSS/OUTER APPLY CAST INTO ORDER BY ASC, DSC Windowing Extensions TumblingWindow HoppingWindow SlidingWindow Date and Time Functions DateName DatePart Day Month Year DateTimeFromParts DateDiff DateAdd Temporal Functions Lag IsFirst CollectTop Scaling Extensions With Partition By Over Aggregate Functions Sum Count Avg Min Max StDev StDevP Var VarP String Functions Len ConCat CharIndex Substring PatIndex

 2013 Allegient. All rights reserved. Fixed window of time with no overlap

 2013 Allegient. All rights reserved. Fixed window of time with a fix time of overlap

 2013 Allegient. All rights reserved. A Fixed window time, but a window is defined as the moment an event enters or exits an existing window.

 2015 Allegient. All rights reserved.

More Information on Streaming Analytics o SAQL o Power BI Implementation Sample dashboard/ dashboard/ Azure Portal Link o Azure Portal Azure Portal Azure Storage Explorer Link o  2015 Allegient. All rights reserved.

 2013 Allegient. All rights reserved. Warren Sifre LinkedIn: