Presentation is loading. Please wait.

Presentation is loading. Please wait.

11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES.

Similar presentations


Presentation on theme: "11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES."— Presentation transcript:

1 11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES

2 Big Data Potential Defining Big Data and Analytics © IDC Energy Insights Visit us at IDC-ei.com 2 Big Data and analytics technologies describe a new generation of technologies and architectures designed to economically extract value from very large volumes of a wide variety of data (structured and unstructured) by enabling high-velocity capture, discovery, and/or analysis.

3 3 BUSINESS PROCESS DATABASE DATA BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze 1X 10X 100X OLTP DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME

4 4 BIG DATA – THE PROMISE The Hype  Turning data flood into transformative insight  Exploration without preconceived notions The Reality  Big Data application stack is complex  Data is highly fragmented  New skill sets  Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video Web Logs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search Federation MPP Meta Data Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results?

5 5 BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains Track/train sensors Keep trains on schedule Proactive maintenance Telemetry from seismic sensors Time series data Operational data from sensors Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange High-speed index service 1/100 th faster

6 6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012 © BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012

7 7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY  60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source © BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012

8 Big Data Potential Volume, Velocity and Variety  More Volume Exploration: WAZ and IsoMetrix Drilling: Nuclear, electromagnetic, acoustic Production: Optical sensors  Potential Value Clearer view of potential resources Help guide a fracking process Show the way to enhancing production  More Velocity Real-time data from SCADA, drill heads, flow sensors, or condition sensors Stream vs. batch processing Complexity involving many engineering disciplines  Potential Value When consequences of failure are great When a delay in processing data may mean missing a bid for an oilfield © IDC Energy Insights Visit us at IDC-ei.com 8  More Variety Structured: Time series, relational Unstructured: CAD drawings, specifications, seismic, well log or daily drilling reports Semi-structured: Processed data  Potential Value Access data previously inaccessible due to multiple access patterns or unstructured nature of data

9 9 BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety Business Decisions E&P Investments Inventory locations Production planning Safety Petabyte to Real Time Unstructured Data

10 10 Growing data > 300 MB / Km 2 early 90s > 25 GB / km 2 in 2006 > Growing… to PBs / km 2  Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data  Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB  Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision VELOCITY – INGEST MORE DATA FASTER

11 11 VOLUME - INSATIABLE APPETITE FOR INFORMATION  Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances  Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source: Henri Calandra, John Etgen, Scott Morton – Rice University Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway.

12 12 VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas:  Many interconnected, increasingly complex and rapidly changing workflows  Exponential growth in the volume of data  Computational demands increasing by orders of magnitude  Manage complexity and increase efficiency  Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads

13 Big Data Potential Data Access Challenges  Data locked in applications on the desktop and cannot be shared efficiently  Legacy data that is in proprietary formats  Storage I/O requirements can still be a challenge. There may not be enough capacity or upload bandwidth.  The workloads may be random or sequential or both in an unpredictable pattern. © IDC Energy Insights Visit us at IDC-ei.com 13

14 14 UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS  Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop  One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency

15 15 OBRIGADO


Download ppt "11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES."

Similar presentations


Ads by Google