Marcelo R.N. Mendes

What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems; Main Characteristics: Flexible; Independent of particular workloads; Not bound to any specific CEP product; Scalable. 2CISUC, University of Coimbra

FINCoS: Architecture 3CISUC, University of Coimbra

FINCoS: Components Driver Simulates external sources of events; Submits load to the SUT; Includes data generation mechanism; Sink Receives query results from CEP engine; Stores output events in log files for subsequent validation. 4CISUC, University of Coimbra

FINCoS: Components Controller Main Interface with the user. Allows to: Create reusable test setups; Control Drivers and Sinks (e.g., load, start, stop); Alter workload parameters on-the- fly (e.g., event submission rates, switch phases) 5CISUC, University of Coimbra

FINCoS: Components Performance Monitor Collect Metrics of Performance Runs Two Modes: Online (integrated into FINCoS Controller); Offline (log files). 6CISUC, University of Coimbra

Lesson 1: Creating a Test Setup 1. Configure a Driver 1. Decomposable Workload 2. Synthetic vs. Thirdy-Party Dataset 3. Data Generation Options 4. Event Arrival Process 2. Configure a Sink October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - unique identifier number of threads used for load generation save generated data to disk? to where Driver send the events machine that hosts the Driver

October, 2012CISUC, University of Coimbra - Workload can be split in independent phases

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Chooses the type of workload for this phase Sets events arrival process Event Mix Events are generated in a ordered way When data generation happens To ensure repeatability…

October, 2012CISUC, University of Coimbra - Configure event types…

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Configure Event Type Schema

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Column Name

October, 2012CISUC, University of Coimbra - Column Type

October, 2012CISUC, University of Coimbra - Data Generation Options

October, 2012CISUC, University of Coimbra - Add Values

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012 CISUC, University of Coimbra - Path for data file. Character used to separate the fields of the records in the data file Timestamp options Type options Fields order Number of times the data in the file must be submitted Controls event submission speed

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - unique identifier List of event types this Sink subscribes to from where Sink receive events machine that hosts the Sink save generated data to disk?

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Done!

Lesson 2: Configuring a new Connection 1. Configure a reusable connection with a CEP engine or JMS Provider October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - unique identifier name of the CEP engine (out-of-the-box support for Esper) Properties used to connect with the CEP engine type of the connection

October, 2012CISUC, University of Coimbra - * supporting new CEP engines requires coding

October, 2012CISUC, University of Coimbra - Done!

Lesson 3: Running Tests 1. Load Drivers and Sinks 2. Start Load Submission 3. Control Load Submission NOTE: At this point the following steps must have been completed: 1. Creation of a test setup; 2. Initialization of the FINCoS Daemon Service at the machines where Drivers and Sinks are intended to run; October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Load components

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Start Load Submission

October, 2012CISUC, University of Coimbra - Sent/Received counts

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

Lesson 4: Collecting Performance Metrics 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

Lesson 4: Collecting Performance Metrics (...cont) 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Configure M.I. here: Optionally, save collected metrics to a file

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra - Select the stream

October, 2012CISUC, University of Coimbra - Select the metric

October, 2012CISUC, University of Coimbra - Select exhibition scale

October, 2012CISUC, University of Coimbra - Add Metrics to the Chart

October, 2012CISUC, University of Coimbra - Change Visualization Options

Lesson 5: Setting Test Options 1. Response Time Measurement October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

October, 2012CISUC, University of Coimbra -

Response Time Measurement Mode October, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send 1 1

Response Time Measurement Mode October, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t4 – t1 End-to-end: From Driver up to Sink

Response Time Measurement Mode October, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t3 – t2 Process Time: From immediately before the input event is forwarded to CEP engine to immediately after the result is received

Download and Feedback FINCoS is available at: Any suggestions or bug reports: October, 2012CISUC, University of Coimbra -