3 BUSINESS PROCESS DATABASE DATA BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze 1X 10X 100X OLTP DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME
4 BIG DATA – THE PROMISE The Hype Turning data flood into transformative insight Exploration without preconceived notions The Reality Big Data application stack is complex Data is highly fragmented New skill sets Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video Web Logs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search Federation MPP Meta Data Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results?
5 BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains Track/train sensors Keep trains on schedule Proactive maintenance Telemetry from seismic sensors Time series data Operational data from sensors Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange High-speed index service 1/100 th faster
9 BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety Business Decisions E&P Investments Inventory locations Production planning Safety Petabyte to Real Time Unstructured Data
10 Growing data > 300 MB / Km 2 early 90s > 25 GB / km 2 in 2006 > Growing… to PBs / km 2 Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision VELOCITY – INGEST MORE DATA FASTER
11 VOLUME - INSATIABLE APPETITE FOR INFORMATION Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source: Henri Calandra, John Etgen, Scott Morton – Rice University Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway.
12 VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas: Many interconnected, increasingly complex and rapidly changing workflows Exponential growth in the volume of data Computational demands increasing by orders of magnitude Manage complexity and increase efficiency Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads
14 UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency