Presentation is loading. Please wait.

Presentation is loading. Please wait.

Complex Events Processing

Similar presentations

Presentation on theme: "Complex Events Processing"— Presentation transcript:

1 Complex Events Processing

2 Remember This? 50 million people affected
Create an interesting opening and compelling story that will be used to provide context for our solution offering. Spend a short time describing this event. 50 million people affected Nuclear power plants in New York and Ohio shut down Air traffic was slowed as flights were halted

3 Why? Electric Power Research Institute (EPRI) White Paper Findings:
Lack of understanding of VAR reserves in the region and the adjacent regions, coupled with the possibility of inadequate dynamic VAR support available from generators. (VAR is shorthand for reactive power, which is the additional power required for maintaining voltage stability when serving certain kinds of load, such as motors, air conditioning, and fluorescent lights.) Insufficient “visibility” of power flow conditions over the entire region, coupled with inadequate coordination, control and communication of the power system on a regional basis. That information is flowing from 27 distribution feeds, eight re-closure or safety switches and 4,192 transformers. Insufficient understanding of the potential impact on August 14, 2003 of new power flow patterns caused by increased wholesale power transfers resulting from industry restructuring. Lack of real-time regional and interconnection-wide power flow models for anticipating changing flow patterns and the formation of new bottlenecks. These are the findings of the Electric Power Research Institute, (an independent, non-profit company performing research, development and design in the electricity sector for the benefit of the public) into the causes of the power outage. The highlighted words describe areas where our solutions can be of help.

4 Enterprise 1.0 Enterprise 2.0 Enterprise 3.0 Data Processing Mainframe
(2000 – 2020) Data Processing Mainframe Client Server Database Predictive ESB Building Block 2-Tier 3-Tier N-Tier Software Batch Online Event Driven Velocity Describe the makeup of each of the generations. When transitioning from Enterprise 2.0 to 3.0, focus on: Moving from a database centric environment to an ESB centric environment Capturing and making use of all events rather than just the information that makes it into the database Functionality distributed across the environment with n-tiers Could use an example of using events such as: potential book buyer online who searches for a book, finds it, is presented the price and then does not complete the transaction. Nothing would appear in the database, however, the events that took place are interesting and usable. The next time this individual enters the site, perhaps a coupon could be offered based on the price sensitivity that the previously captured events demonstrated. 000’s 000,000’s 000,000,000,000’s Interactions 4

5 Enterprise 1.0 Enterprise 2.0 Enterprise 3.0 Data Processing Mainframe
(2000 – 2020) Half Life of Data Amount of Data Time to React Data Processing Mainframe Client Server Database Predictive ESB Building Block 2-Tier 3-Tier N-Tier Software Batch Online Event Driven Velocity Additional characteristics of the evolution to Enterprise 3.0: -the amount of data is drastically increasing -the useful life of data (before it is out-of-date) is decreasing rapidly -the time to react to new data is decreasing rapidly 000,000’s 000,000,000’s 000,000,000,000’s Interactions 5

6 The Data Advantage Threats & Opportunities Events Enterprise 3.0
Transactions Enterprise 2.0 This graphically illustrates the evolution to an event driven Enterprise 3.0 world where we can use events to minimize threats and take advantage of opportunities like the online book buying example that was mentioned previously. 6

7 Understanding The Event Cloud
Enterprise Events

8 Deriving Value from Events
CEP Enterprise Events

9 CEP enables More Effective Decisions
Dynamic Business Conditions Point of Transaction Response to Dynamic Conditions Business Automation  Enables Fast Response Effective Real-time Decisions Business Event Result Measured Root Cause Determined Potential Business Value Corrective Decision Made BE enables the users to make more effective decisions by decreasing the time it takes to act. Especially in today’s business environment where “business processes are automated” & “business conditions change dynamically” –> Real-Time business decisions is part of the key to success. Companies have invested significant $ over the last decade and a half to automate their business processes, . These processes do well in predictable conditions. However, Business is dynamic - and the environment (Market, Customer, partners, employees, internal systems) and conditions can change. As these automated processes do not respond well and quickly to the changing conditions that business results suffer. Our analysis tells us that the longer the delay between an event of interest (or a condition change) occurred TO when we diagnose and take corrective action, the lower is the value of that decision to the business. Reducing that latency between those two is the goal of real-time BI. Action Taken Action time

10 Using Real Time Events = A Better Way to Fly
Agenda Overview and vision for Complex Event Processing Real-time customer problems and solutions TIBCO BusinessEvents capabilities Answer your questions

11 Complex Event Processing (CEP): Premises
Business Optimization Business Process Management Service- Oriented Architecture Problem There is always a “Plan”. It Never Goes According to the “Plan”. A “Pattern of Events” is an indicator of “opportunities” (inventory re-allocations). A “Pattern of Events” is an indicator of “threats” (fraud, inventory shortages). A “Pattern of Events” can be reactive situations. A “Pattern of Events” can be predictive (early warning) situations. Solution CEP is the foundation technology for detecting patterns in real-time event streams correlated with historical data. Enumerate the challenges that Complex Event Processing can help with and try to relate to the specific issues that your prospect has.

12 Velocity drives need for Event Processing
Business Cycle-Time Improvements Perform Trading Analytics 1 hour Mail… express… fax… 20 seconds 1 day 5 seconds 30 seconds 10 seconds 5 minutes 15 minutes 30 minutes Airline Operations 20 minutes Handle Call Center Inquiries 8 hours Track Financial/Risk Position 1 day Supply Chain Updates 1 day Document Transfer 3 days Phone/Service Activation 3 days Refresh Data Warehouse Over the past 20 years, almost all industries have experienced significant acceleration of their core processes. Activities that took days now take less than an hour and in many cases just minutes or even seconds. Documents can be send in 30 seconds rather than 30 minutes Stock trade can be settled in less than a day Airline tickets can be bought in 20 seconds instead of 20 minutes Organizations use these improvements to become market leaders. We work with our customers constantly to identify their unique opportunities for improving business results by accelerating the speed at which processes are executed. Later in this presentation, we will provide some examples. (supporting notes) Link to customer success stories online: 1 month Settle Trade/Transaction 5 days Build-to-Order Product 6 weeks Source: Gartner

13 Operational Intelligence in Transport & Logistics

14 Context-based Decisions in Operations
Aircraft Operations Dispatch, Weather Crew Management Aircraft Communications and Operations Airport Operations Schedule Planning Aircraft Maintenance Early Alert System

15 Events driving Airline Scenarios
March Madness Example An abnormally large number of “no shows” in one day could mean a mass of extras tomorrow Station alerting for passenger patterns, monitor check-in patterns and no-show rate Flow Rates in/out of airport Only X aircraft getting out of airport, but Y>X aircraft are arriving there Prevent/avoid gridlock, compare gate and off-gate parking capacities + numbers of passengers transferring to which flights

16 The Goal: Total Situational Awareness
Require: Better visibility into aircraft operations across all stations Apply rules to all inputs and report situations that are out of tolerance Display alerts in a meaningful way to inform not confuse Motivation: In Dec 2006 said by year-end 2007, new application development projects in enterprises will have to, at a minimum, pay "lip service" to the notion of RIAs to have sufficient credibility to gain project support (80% probability).

17 Complex Event Processing Solution
Aircraft Communications and Operations Dispatch, Weather Enterprise Messaging Enterprise Integration Operational Data ODS Services Customer CST Enterprise Warehouse EDW Other Optimizers & Solvers TIBCO BusinessEvents Match events & rules

18 Results Aircraft loading 6.25 flights/day/aircraft 544 aircraft
Flight Passengers >86M passengers Aircraft Event Volume >60K Msgs/Day Customer satisfaction “Lowest ratio of complaints per passengers boarded of all Major U.S. carriers “ “Diamond Award, at the Air Cargo World awards ceremony, with the highest overall airline score leading all airlines in the Performance and Value categories.” “Favorite Domestic Airline and ranked #1 in Best Customer Service, Best Airfare Prices, Best On-Time Service, Best Baggage Service, and Best Value Frequent Flier program, among others, in the Reader’s Choice Awards by Smarter Travel.” ...

19 Union Pacific Railways - Challenges
Pre-existing Business Challenges: Less than half of all network schedules achieved. Track velocity = 17 mph. Goal is 20 mph; every increase in 1 mph = $10 million saving to the bottom line (each month!). Customers over-schedule and use crews unwisely. Appear at capacity but a system of over-schedule.

20 Union Pacific Railways - Benefits
Maintenance & Crew Management Outsourcer instantly knows where to deliver new crews Automatically exchange locomotive maintenance order, fulfilment and invoicing data with service providers and business partners Trains run 1/8th mile per hour faster! Way Side Detection Real-time Alerting of wayside diagnostic alerts Service Enabled Maintenance System Pro-actively fix wheels with faulty bearings

21 TIBCO BusinessEvents v5.0 ® The 5th Generation Event Platform

22 BusinessEvents - Overview
BE is a framework for messaging based intelligent, distributed agents 2. REASON Define rules of behavior to reason on a pattern of objects, events and time Rules Patterns 4. SITUATION Visualize Predictive Enterprise Actions 3. INFER Actions 1. SENSE Ability to listen to events and gather data on demand. TIBCO BusinessEvents can be described not only as a CEP engine but also as an event-driven rule or real-time rule engine. TIBCO BusinessEvents enables CEP problem to be solved through a model dirven approach. In which the developer defines the event, rule, concept(class) and state models. It is a high performance Low Latency application which can also Persists real-time data using a highly distributed platform Events Objects

23 BusinessEvents: State-Oriented CEP Behavior
Event Bus or Source Low-latency reliable Message delivery Event and Data Model For Information Modeling Temporal Model For Determining Time-Dependent Information Pattern Detection Model For Recognizing Patterns and Defining Actions History and Cache New Order Condition / TimeEvent State Model State 1 State 2 BE definition slide for use instead of UML / standards slide

24 Concept Model Stateful object modelling.
Easily visualize object relationships. Concept model describes the data concepts used in BusinessEvents which may be mapped from events or their payload. Concepts A definition of a set of properties that represent datafields of an application entity Can model such things as inheritance, containment, and reference other concepts ie an order can reference lineItems and derive from some other higher level object Concepts include State models

25 State Model / Process Flow
UML-Compliant state model. State diagram / flow diagram is simple to follow and maintain. A state model describes the states that an entity can hold , and the transitions between states that are allowed, and the conditions for such transitions.

26 BusinessEvents: Rule-Oriented CEP Behavior
New Order (Lots of Events) Event Bus or Source Low-latency reliable Message delivery Event and Data Model For Information Modeling Temporal Model For Determining Time-Dependent Information Pattern Detection Model For Recognizing Patterns and Defining Actions History and Cache Rule Complex Patterns Reaction BE definition slide for use instead of UML / standards slide

27 Inference Rule Features
High Performance Pattern Matching Large catalogue of functions built in. Rules provide one of the main behavioral mechanism in BE. Rules are defined in terms of declaration (events and concepts of interes) , conditions(filters and joins on and between the attributes of the events and concepts), and action. The combination of rule declaration and condition defines the event pattern required for CEP operations.

28 Decision Manager Features
Rules managed in a decision-table interface. Export/import to and from Excel. Its friendly user interface allows business personnel with little or no technical background to author, test, and deploy business rules to the BusinessEvents engine. Decision Manager is the client to a server component called RMS, which is a rules management server. RMS manages the lifecycle of decision projects and provides an approval work flow.

29 BusinessEvents: Query-Oriented CEP Behavior
New Order (Lots of Events) Event Bus or Source Low-latency reliable Message delivery Event and Data Model For Information Modeling Temporal Model For Determining Time-Dependent Information Pattern Detection Model For Recognizing Patterns and Defining Actions History and Cache Query Complex Query Results Event

30 Query CEP Agent Features
Common query language Based on SQL/OQL Familiar to SQL users. Defined dynamically or statically. API similar in structure to JDBC. select city, count(*) from LoanApp {policy: maintain last 7 days where amount > } group by city

31 BE Views Provides visibility into real-time business events
Empowers users to make effective real-time decisions and appropriate actions on critical opportunities and issues. It is a Real time streaming / live business and operational dashboard Dashboard is browser based and built in flash Charts are streaming and update in real-time Provides a real-time UI for events / messages Events can be sourced from: BPM, CEP, SOA… BE Views provides the full lifecycle of event capture, management, and display. BE Views provides real-time dashboards that Monitor automated decisions made in BE Allows users to identify and address issues in real-time to improve the efficiency and performance of the business Provides visibility into real-time business events (from processes, transactions, sensors, services etc) in a customizable, intuitive visual interface

32 TIBCO BusinessEvents Thematic Summary
Pattern Detection Decisions Processes and Views TIBCO BusinessEvents Complex Event Processing (CEP, ESP) Decision Management (business rules) Straight Thru Processing (real-time process eventing) Real-time Dashboards (real-time Inter-active BI)

33 Application to SITS

34 Enterprise 2.0 in Action Remember this picture? Now let’s relate it back to what could have happened in an Enterprise 3.0 enabled organization.

35 Enterprise 3.0 It's so smart that it knew there was a power outage in one neighborhood 34 minutes before the first resident called the utility. It's so smart that the number of customer-voltage complaints — about either surges or drops — went from 70 to zero. It's so smart that it identified a transformer that was overloaded and needed to be replaced — before it got fried. In the past, the utility knew to replace transformers when they blew and lights went out. The next step: to collect and share information with about 25,000 homes and businesses that have installed or will install "smart meters.“ A current customer who is using our technology to achieve better results by operating in an Enterprise 3.0 way.

36 Sample Event Processing Usage Summary
Adaptive Marketing Pattern: Capture opportunity with customer while ‘the window is open’. Telco SLA (Service Assurance) Real Time Service Offers and Analytics Finance Fraud Detection Track and Trace Trades/Deals/Settlements Pre/Post trade exceptions Logistics - Track & Trace Track Packages against a “Plan”. Infer package delays in a proactive manner. Alert customers. Government Track and Analyze ‘patterns’ that were otherwise very difficult to detect Dynamic Resource Scheduling Real Time Optimization of Resources against a “Plan”.

37 Next Steps us to receive High Consequence Architecture White Paper For more information  or to arrange a meeting to discuss your business problem  contact Atif Chaughtai (301)

38 Questions?

Download ppt "Complex Events Processing"

Similar presentations

Ads by Google