We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published bySebastian Larner
Modified over 2 years ago
Complex Event Processing Prof. Richard Holowczak © 2007-2013 Richard Holowczak All rights reserved.
Streams of Data RFID scans Transportation / Traffic scans Web site visits Server logs Financial / Market data Manufacturing Processes Environmental monitoring / Remote sensing Gaming events © 2007-2012 Richard Holowczak All rights reserved. 2
Challenges of Streaming Data Data may arrive and demand action at a rate faster than a traditional database can respond Require flexibility / generalizability in coding approaches –Compare custom C++/Java vs. a query language like SQL © 2007-2012 Richard Holowczak All rights reserved. 3
DBMS vs. Stream Processing © 2007-2012 Richard Holowczak All rights reserved. 4 Insert Event Database Data Query Result Action 1 2 3 4 5 Insert Event Database Data Query Action 1 2 Query Result 3 4 5 CEP DBMS CEP
© 2007-2012 Richard Holowczak All rights reserved. 5 Event Processing Vendors Generic Systems –Oracle CEP www.oracle.com/us/products/middleware/soa/event- processing –Amazon Kinesis aws.amazon.com/kinesis –SQL Stream www.sqlstream.com Financial Services - Oriented –Sybase Aleriwww.aleri.com –TIBCO StreamBasewww.streambase.com –Apama www.softwareag.com/corporate/products/bigdata/apama/
© 2007-2012 Richard Holowczak All rights reserved. 6 Stream / Event Processing Data arrives in a stream, e.g. –Weather data –RFID scans –Market Data Rules put in place to match patterns in one or more streams When a rule is satisfied trigger and Event or Alert –Possibly triggering some further actions
© 2007-2012 Richard Holowczak All rights reserved. 7 Complex Event Processing – Example from Apama Source: Algorithmic Trading: The use of algorithms in automated trading. by John Bates. Dr. Dobb's Portal. March 9, 2007 http://www.ddj.com/hpc-high-performance-computing/197801615
© 2007-2012 Richard Holowczak All rights reserved. 8 CEP – Apama Example Trading Rule Source: Algorithmic Trading: The use of algorithms in automated trading. by John Bates. Dr. Dobb's Portal. March 9, 2007 http://www.ddj.com/hpc-high-performance-computing/197801615
Oracle CEP Example © 2007-2012 Richard Holowczak All rights reserved. 9
Oracle CEP Applications Adapters – connect inbound and outbound data streams (can also be relational databases) Channels – act as queues accepting data and passing it along to processors Processors (event processing agents) – applies standing queries to channels and produces output events / signals Beans / Event Beans – Java Beans apps that are triggered by events – carry out the work when an event occurs © 2007-2012 Richard Holowczak All rights reserved. 10 From: http://www.oracle.com/technetwork/middleware/complex-event-processing/overview/oracle-47.pdf
Oracle CEP Development Tools © 2007-2012 Richard Holowczak All rights reserved. 11
Oracle Continuous Query Language (CQL) Two main data objects to operate on: Streams and Relations Stream and Relational (SQL) operators –Oracle CEP CQL Language Reference http://docs.oracle.com/cd/E23943_01/apirefs.1111/e12048/toc.htm © 2007-2012 Richard Holowczak All rights reserved. 12
Service Oriented Architecture Service Enablement of Existing Systems Service Oriented Architecture.
Agenda Introduction Background to CEP Complex Event Processing Stream Insight Anatomy of a Stream Insight Project.
Complex Event Processing Standards Bob Marcus. Motivation for the CEP Standards Session Complex Event Processing (CEP) technology is an essential complement.
INNOV-10 Progress® Event Engine™ Technical Overview Prashant Thumma Principal Software Engineer.
Oracle to MySQL Database Migration SQLWays - Migration Software Presentation Copyright (c) Ispirer Systems Ltd. All Rights Reserved.
Introduction to Grid Application On-Boarding Nick Werstiuk
Progress Report 11/1/01 Matt Bridges. Overview Data collection and analysis tool for web site traffic Lets website administrators know who is on their.
| © 2013 Axway | All rights reserved. 1 Govern the Flow of Data: Moving from Chaos to Control Steve Jordan Director, Industry Marketing.
John Plummer Technical Specialist Data Platform Microsoft Ltd StreamInsight Complex Event Processing (CEP) Platform.
© 2010 TIBCO Software Inc. All Rights Reserved. Confidential and Proprietary. TIBCO Spotfire Application Data Services TIBCO Spotfire European User Conference.
How well REALLY move to the cloud – the coming alignment between hosters and cloud platform providers Dave Wright.
1 Chapter 9: The Client/Server Database Environment Modern Database Management 7 th Edition Jeffrey A. Hoffer, Mary B. Prescott, Fred R. McFadden.
Data Management Conference Introducing SQL Server 2008 R2 Mark Linton Director of WW Marketing SQL Server Business Group
COMP-12: Building Apama Applications Picking the Right Tools John Trigg Principal Product Manager, Progress Apama.
Contact Arvind Verma Corporate Profile.
HOL9396: Oracle Event Processing 12c Fast Data development with Oracle Event Processing 12c Lloyd Williams Principal Product Manager Business Integration.
Next-Generation IDS: A CEP Use Case in 10 Minutes 3rd Draft – November 8, nd Event Processing Symposium Redwood Shores, California Tim Bass, CISSP.
Comprehensive Flexible Global Storage and Search Responsive Available Secure Manageable Federation Coordination Consolidation Transformation Synchronization.
ManageEngine IT360 Product Overview
1 Introduction to Data Management. Understand: meaning of data management history of managing data challenges in managing data approaches to managing.
1 ORACLE DATABASE Salim Phone: YM: talim_bansal.
CS453: Databases and State in Web Applications (Part 2) Prof. Tom Horton.
New Release Announcements and Product Roadmap Chris DiPierro, Director of Software Development April 9-11, 2014
Oracle Fusion Middleware 11g Abhishek Khanolkar. What is Oracle Fusion? “Oracle Fusion Middleware is a ‘preintegrated’ portfolio of customer- proven software.
Chapter 3 Database Architectures and the Web. Multi-User DBMS Architectures u Teleprocessing u File-server u Client-server.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 13 Slide 1 Application architectures.
1 Effective, secure and reliable hosted security and continuity solution.
Application architectures. Objectives l To explain the organisation of two fundamental models of business systems - batch processing and transaction processing.
Websydian Anne-Marie Arnvig Manager, Websydian Communications & Relations.
© 2009 IBM Corporation Maximize Cost Savings While Improving Visibility Into Lines of Business Wendy Tam, CDC Product Marketing Manager
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
C7:Complex Event Processing Making Sense of Sensor Network Events in Real Time John Doherty Senior Presales Consultant.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. SAP BO vs SPLUNK vs OBIEE By Lera Technologies.
Introduction to ORM Hibernate Hibernate vs JDBC. May 12, 2011 INTRODUCTION TO ORM ORM is a programming technique for converting data between relational.
Erik Jan van Vuuren – Product Lead Windows Azure Opportunities with Cloud, Data and Devices.
Rainbow: XML and Relational Database Design, Implementation, Test, and Evaluation Project Members: Tien Vu, Mirek Cymer, John Lee Advisor:
21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.
1 DLMSO/DAASC November 2006 Supply PRC Meeting DLMS Bridge Middleware October, 2007 DLMSO Defense Logistics Management Standards Office.
Teradata to Oracle SQLWays – DDL/Schema, Views, Macros, Procedures, BTEQ, Applications Migration Copyright (c) Ispirer Systems.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Hewlett-Packard.
Application architectures. Topics covered Data processing systems Transaction processing systems Event processing systems Language processing systems.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 17 Client-Server Processing, Parallel Database Processing,
MBA 664 Database Management Systems Dave Salisbury ( )
© 2013 IBM Corporation Reducing Cost with R in IBM Storage Products Manufacturing Elaine Jones Integrated Supply Chain Engineering.
DAVID M. KROENKE’S DATABASE PROCESSING, 10th Edition © 2006 Pearson Prentice Hall 7-1 David M. Kroenke’s Chapter Seven: SQL for Database Construction and.
Chapter 17: Client/Server Computing Business Data Communications, 4e.
Opening Keynote Presentation An Architecture for Intelligent Trading Alessandro Petroni – Senior Principal Architect, Financial Services, TIBCO Software.
An overview of Data Warehousing and OLAP Technology Presented By Manish Desai.
1 Overview of Databases. 2 Content Databases Example: Access Structure Query language (SQL)
SQL Server to MySQL Database Migration SQLWays - Migration Software Presentation March 2009 Copyright (c) Ispirer Systems Ltd.
© 2017 SlidePlayer.com Inc. All rights reserved.