When Big Data Meets Fast Data 23 November 2016 When Big Data Meets Fast Data - Paris 2016 Nicolas Baret Senior Pre-Sales Consultant

When Big Data Meets Fast Data The Evolution of Hadoop Enterprise ready From batch to real-time Now add Cloud It’s all About the Architecture Lambda / Kappa How Change Data Capture (CDC) Enables Big and Fast Data

The Evolution of Hadoop The First 10 Years Operationalising Hadoop Real-time and streaming Hadoop and the cloud Compose automates the DW process to enable agile BI and tighter collaboration between IT and the business. This entails three primary benefits: accelerating DW projects, optimizing the DW process and reducing risk.

Operationalising Hadoop Hadoop has won the battle Moved out of Dev and Test Enterprise demands more Closer to production Business impact Sqoop Financial Services Use Case 1000+ business applications Classic data lake Moved to level 3 infrastructure supporting level 1 applications

The Evolution of Hadoop The First 10 Years Operationalising Hadoop Real-time and streaming Hadoop and the cloud The second primary benefit of Attunity Compose is optimizing the DW process.

Real-time Streaming with Kafka Real-time processing Real-time monitoring Real-time Hadoop Big and Fast Data Scalable to 1000’s applications Online Retail – Use Case Streaming Data to Kafka Multiple data Feeds Multiple data Consumers Online Credit card transaction failure  Under 20 seconds a real person calling you back and helping with the transaction

The Evolution of Hadoop The First 10 Years Operationalising Hadoop Real-time and streaming Hadoop and the cloud The final major benefit of Attunity Compose is risk reduction.

Combining Hadoop and the Cloud Targets Sources On Premises Cloud Platform Hadoop RDBMS Data Warehouse Replicate provides a single centralized solution for both the enterprise and the Cloud. You are able to configure, manage and monitor the movement of data to Amazon Web Services, Microsoft Azure and Google Cloud using the same user interface.

Universal Data Availability Fortune 100 automotive maker Results Consolidating massive data volumes for global analytics Hadoop Data Lake with Kafka Minimising labour and cost Realising faster insights and competitive advantage 4500 applications DB2 MF SQL Oracle

The Evolution of Hadoop Operationalising Hadoop Financial services – enterprise use cases Real-time and streaming Online retail – customer success Hadoop and the cloud Global Data Lake The final major benefit of Attunity Compose is risk reduction.

It’s all About the Architecture Lambda or Kappa

What is Lambda / Kappa ? The Speed/Event Layer The Batch Layer Has the Stream Processing Architecture where we will be processing the Streaming data The Batch Layer Holds all the historical Data - has two functions: Managing the master dataset (an immutable, append-only set of raw data) To pre-compute the batch views The Serving Layer Simply queries the batch and real-time views and merges them

What is Lambda? Lambda architecture describes a system consisting of three layers: Batch processing Speed (or real-time) processing, Serving layer for responding to queries

Lambda – Batch, Speed, Server Speed Layer Server Layer Query1 n 2 Query2 Batch Layer Data Feeds View1 n 2 1 View2 View3

Kappa –Speed, Server then Batch Server Layer Speed Layer Query1 n 2 Query2 Batch Layer Data Feeds View1 n 2 1 View2 View3

MapR - Architecture

How Change Data Capture (CDC) Enables Big and Fast Data With Attunity Replicate

CDC Enables the Flow  Kafka  Streams In memory optimised metadata management and data transport CDC Data Streaming JSON data format MSG n 2 1 Message broker Transaction logs Bulk Load Data Streaming JSON data format MSG n 2 1 Message broker Batch data

Intuitive User Experience Configurable, Pre-defined Automation Intuitive and easy to use web-based interface Simple to configure and manage replication tasks Single interface for any supported source to target Easy management with alerts and notifications First and foremost our customers find that the product is very easy to deploy and use. It provides a single web-based interface - regardless of the type of source systems or target systems. All of the functions to configure, control and monitor the replication tasks are provided through an intuitive graphical interface.

Easily Create and Manage Kafka Endpoints Attunity Replicate Eliminate manual coding Drag and drop interface for all sources and targets Monitor and control data stream through web console Bulk load or CDC Multi-topic and multi-partitioned data publication Command Line "table": "table-name", "schema": "schema-name", "op": "operation-type", "ts": "change-timestamp", "data": [{"col1": "val1"}, {"col2": "val2"}, …., {"colN": "valN"}] "bu_data": [{"col1": "val1"}, {"col2": "val2"}, …., {"colN": "valN"}],

Attunity Replicate’s Differentiators Easy – Configurable, powered by automation (no dev or scripting) Change Data Capture (CDC) – Efficient, low latency and no downtime Zero Footprint – No agent on source database server Heterogeneous – Supports many data sources and targets Optimised – Integrated with native target system APIs

Attunity Corporate Overview Global Organisation Over 2000 Customers in 65 Countries Financial Services Manufacturing / Industrials Health Care Government EMEA USA APAC Enterprise Data Management On Premise | Cloud | Across Platforms Technology / Telecommunications Other Industries Attunity is a publicly traded, global organization – with offices around the United States, Europe and Asia Pacific. We have over 2000 customers in 65 countries. And our focus is delivering Enterprise Data Management solutions across platforms for both on-premises and the cloud. Our mission is to help organizations: accelerate the data delivery across enterprise and cloud enable organization to gain value our of the data quickly and continually improve the management of data with intelligent insight. Accelerate data delivery across enterprise and cloud Empower rapid utilisation of data by the business Continually optimise with intelligent insight

Attunity – Trusted Technology and Partner Trusted by Microsoft with 3 OEMs, bundled inside SQL Server Trusted by Amazon (AWS) with technology licensing for cloud migration service Trusted by IBM and Oracle with respective OEMs of Attunity technology Trusted by Teradata as a reseller for Data warehouse and Hadoop market Trusted by HP as a reseller for Data warehouse and analytics market Trusted by Accenture, Capgemini and Cognizant as SI partners Trusted by Hortonworks, Cloudera and MapR for Hadoop solutions Trusted by over 2000 customers in over 65 countries

CDC enables the Evolution of Hadoop Operationalising Hadoop Financial services – enterprise use cases Real-time and streaming Online Retail – customer success Hadoop and the cloud Global Data Lake The final major benefit of Attunity Compose is risk reduction.

Q&A and Additional Resources Contact Us Follow Us info-uk@attunity.com Come see us at our stand www.attunity.com/resources @attunity http://Linkd.in/attunity FREE TRIAL attunity.com/replicateexpress