Presentation is loading. Please wait.

Presentation is loading. Please wait.

Has the ETL run yet?

Similar presentations


Presentation on theme: "Has the ETL run yet?"— Presentation transcript:

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21 Has the ETL run yet?

22

23

24

25

26

27 Microsoft StreamInsight 27 CEP Engine Output Adapters Input Adapters Event Standing Queries Event sources Event targets Devices, Sensors Web servers Event stores & Databases Stock tickers & News feeds Event C_IDC_NAMEC_ZIP Event stores & Databases Pagers & Monitoring devices KPI Dashboards, SharePoint UI Trading stations Event CEP Application at Runtime Static reference data IDE.NET C# LINQ CEP Application Development

28

29 Events t1 t4 t3 t2 t5 Time  Payload/ value  a b c d e

30 Event Types Events in Microsoft’s CEP platform use the.NET type system Events are structured and can have multiple fields Fields are typed using the.NET framework types CEP engine provisioned timestamp fields capture all the different temporal event characteristics Event sources populate time stamp fields Timestamps/Met adata Long pumpID String Type String Location Double flow Double pressure ………………

31 Event Streams & Adapters 31

32 LINQ Query Examples LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; Join Filter Project Grouping Window Project & Aggregate

33 Tumbling Window

34 Hopping Window

35 StreamInsight Hosting Models CEP in-process server (explicit model) Application CEP explicit logic CEP Server Application In-process server mode Hosted server mode

36

37 UI application StreamInsight Server Query UI application Output Adapter Input Adapter

38

39 UI application StreamInsight Server Query Output Adapter Input Adapter

40

41 UI application StreamInsight Server Query Output Adapter Input Adapter Event tracking

42

43 PowerPivot UI StreamInsight Server Query Output Adapter Input Adapter Event tracking PowerPivot UI

44

45

46 www.microsoft.com/teched www.microsoft.com/learning http://microsoft.com/technet http://microsoft.com/msdn

47

48 Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st http://northamerica.msteched.com/registration You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year

49

50


Download ppt "Has the ETL run yet?"

Similar presentations


Ads by Google