Has the ETL run yet?

Slides:



Advertisements
Similar presentations
Financial Services Technology Expo Microsoft StreamInsight for Financial Services A Microsoft Point of View Presentation Hilton New York Hotel New York,
Advertisements

Overview of Microsoft StreamInsight
3 Business Intelligence with the world’s most popular business productivity suite and most widely deployed information platform IT management & developer.
SQL Server 2008 R2 StreamInsight Complex Event Processing Event Stream Processing.
5 Complex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarative query.
DBI303. SELECT COUNT(*) FROM ParkingLot WHERE type = ‘AUTO’ AND color = ‘RED’ SELECT COUNT(*) FROM ParkingLot WHERE type = ‘AUTO’ AND color = ‘RED’
Jason Tolley Technical Director ROK Technology Pty Ltd SESSION CODE: WEM305.
Business Productivity Suite Business Collaboration Platform Information Platform Reporting Services ReportsCentral Admin.
Laura Chappell Author Wireshark Network Analysis: The Official Wireshark Certified Network Analyst Study Guide wiresharkbook.com SESSION CODE: SIA336.
Sometimes it is the stuff you know that hinders true progress.
The Secrets of Effective Technical Talks: How to Explain Tech without Tucking Them In! Presented by Mark Minasi and Mark Russinovich SESSION CODE: SIA334.
Ashwin Sarin Program Manager Microsoft Corporation SESSION CODE: COS204.
Maciej Pilecki Consultant, SQL Server MVP Project Botticelli Ltd. SESSION CODE: DAT403.
Olivier Bloch Technical Evangelist Microsoft Corporation SESSION CODE: WEM307.
Design Solutions in ExcelShare them on SharePoint 9.
An Extensible Test Framework for Microsoft StreamInsight Alex Raizman Asvin Ananthanarayan Anton Kirilov Badrish Chandramouli Mohamed Ali.
Boris Jabes Senior Program Manager Microsoft Corporation SESSION CODE: DEV319 Scale & Productivity in Visual C
Peter Provost Sr. Program Manager Microsoft Corporation SESSION CODE: DEV403.
John Plummer Technical Specialist Data Platform Microsoft Ltd StreamInsight Complex Event Processing (CEP) Platform.
Kevin Cox – SQL CAT Microsoft Corporation What are the largest SQL projects in the world? SESSION CODE: DAT305 Srik Raghavan –
Data Management Conference Introducing SQL Server 2008 R2 Mark Linton Director of WW Marketing SQL Server Business Group
Joe SchulmanAdrienne WuProgram ManagerMicrosoft Corporation SESSION CODE: SIA319.
END USER TOOLS AND PERFORMANCE MANAGEMENT APPS Excel PerformancePoint Svcs/ProClarity BI PLATFORM SQL Server Reporting Services SQL Server Reporting Services.
Janssen Jones Virtual Machine MVP Indiana University SESSION CODE: VIR403.
Bradley Millington Senior Program Manager Microsoft Corporation SESSION CODE: WEB 306.
Suhail Dutta Program Manager Microsoft Corporation SESSION CODE: DEV402.
Thomas Deml Principal Program Manager Web Platform and Tools Microsoft Corporation SESSION CODE: WEB308.
Paul Litwin Programmer Manager Fred Hutchinson Cancer Research Center SESSION CODE: WEB206.
Omar Khan SESSION CODE: WSV331. Simplification.
Jeff King Senior Program Manager, Visual Studio Microsoft Corporation SESSION CODE: WEB305.
Lori Dirks Expression Community Manager Microsoft Corporation SESSION CODE: WEB309.
Chris Mayo Microsoft Corporation SESSION CODE: UNC207.
Bob Beauchemin Developer Skills Partner SQLskills SESSION CODE: DAT402.
Olivier Bloch Technical Evangelist Microsoft Corporation SESSION CODE: WEM308.
Richard Campbell Co-Founder Strangeloop Networks SESSION CODE: WEB315.
Younus Aftab Program Manager Microsoft Corporation SESSION CODE: WSV324.
Srinath Venkatasubramanian Alliance Manager Sonata Software Limited SESSION CODE: BIP203.
2 Complex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarative query and pattern.
SESSION CODE: MGT205 Chris Harris Program Manager Microsoft Corporation.
Reza Chitsaz Senior Program Manager Microsoft Corporation SESSION CODE: DEV302 Building a SharePoint Collaboration Application in Visual Studio 2010.
Andrew Connell, MVP Developer, Instructor & Author Critical Path Training, LLC. SESSION CODE: OSP305.
Introducing Visual Studio 2010: What It Is and Why You Should Care
BIO202 | Building Effective Data Visualizations and Maps with Microsoft SQL Server 2008 Reporting Services BIU08-INT | Using.
Comprehensive Flexible Global Storage and Search Responsive Available Secure Manageable Federation Coordination Consolidation Transformation Synchronization.
Martin Woodward Program Manager Microsoft Corporation SESSION CODE: DEV308.
SESSION CODE: COS301. So what do we do?
Mir Rosenberg & Refaat Issa Program Managers Microsoft Corporation SESSION CODE: WSV401.
Dustin Johnson Microsoft Practice Lead Dell, Inc. SESSION CODE: UNC302.
David A. Carley Senior SDE Microsoft Corporation SESSION CODE: DEV318.
By: Paul D. Sheriff or SESSION CODE: WCL206.
Cube Measure Group Measure Partition Cube Dimension Dimension Attribute Attribute Relationship Hierarchy Level Cube Attribute Cube Hierarchy.
Maarten Struys Windows Phone Evangelist Alten PTS SESSION CODE: WPH303.
Rob Tiffany Mobility Architect Microsoft Corporation SESSION CODE: WPH306.
Brian A. Randell Senior Consultant MCW Technologies SESSION CODE: DEV311.
Christophe Fiessinger & Jan Kalis Senior Technical Product Manager Microsoft Corporation SESSION CODE: OSP209.
Event-Driven Stream Processing with Microsoft StreamInsight Roman Schindlauer.
Ken Getz Senior Consultant MCW Technologies, LLC SESSION CODE: WCL202.
3 Business Intelligence with the world’s most popular business productivity suite and most widely deployed information platform IT management & developer.
Tobias Ternstrom Senior Program Manager Lead SQL Server Engine SESSION CODE: DAT404.
Luke Hoban Senior Program Manager Microsoft Corporation SESSION CODE: DEV307.
Andrew Connell, MVP Developer, Instructor & Author Critical Path Training, LLC. SESSION CODE: OSP319.
Tim Laverty – Diego Vega – Program Managers Microsoft Corporation SESSION CODE: DEV305.
Stephen Forte Chief Strategy Officer Telerik stephenforte.net SESSION CODE: DEV303 Building Data Driven RESTful Applications.
Tech·Ed  North America /11/ :01 AM SESSION CODE: DEV405
Tech Ed North America /19/2018 4:59 AM Required Slide
Advanced Dashboard Creation Using Microsoft SharePoint Server 2010
Advanced Microsoft SQL Server 2008 R2 StreamInsight
Delivering an End-to-End Business Intelligence Solution
Lap Around the Windows Azure Platform
Building BI applications using PowerPivot for Excel
Presentation transcript:

Has the ETL run yet?

Microsoft StreamInsight 27 CEP Engine Output Adapters Input Adapters Event Standing Queries Event sources Event targets Devices, Sensors Web servers Event stores & Databases Stock tickers & News feeds Event C_IDC_NAMEC_ZIP Event stores & Databases Pagers & Monitoring devices KPI Dashboards, SharePoint UI Trading stations Event CEP Application at Runtime Static reference data IDE.NET C# LINQ CEP Application Development

Events t1 t4 t3 t2 t5 Time  Payload/ value  a b c d e

Event Types Events in Microsoft’s CEP platform use the.NET type system Events are structured and can have multiple fields Fields are typed using the.NET framework types CEP engine provisioned timestamp fields capture all the different temporal event characteristics Event sources populate time stamp fields Timestamps/Met adata Long pumpID String Type String Location Double flow Double pressure ………………

Event Streams & Adapters 31

LINQ Query Examples LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; Join Filter Project Grouping Window Project & Aggregate

Tumbling Window

Hopping Window

StreamInsight Hosting Models CEP in-process server (explicit model) Application CEP explicit logic CEP Server Application In-process server mode Hosted server mode

UI application StreamInsight Server Query UI application Output Adapter Input Adapter

UI application StreamInsight Server Query Output Adapter Input Adapter

UI application StreamInsight Server Query Output Adapter Input Adapter Event tracking

PowerPivot UI StreamInsight Server Query Output Adapter Input Adapter Event tracking PowerPivot UI

Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year