11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES.

Slides:



Advertisements
Similar presentations
Setting Big Data Capabilities Free How to Make Business on Big Data? Stig Torngaard, Partner Platon.
Advertisements

Cisco and NetApp Confidential. Distributed under non-disclosure only. Name Date FlexPod Entry-level Solution FlexPod Value, Sized Right for Smaller Workloads.
© 2009 VMware Inc. All rights reserved Big Data’s Virtualization Journey Andrew Yu Sr. Director, Big Data R&D VMware.
Information Systems In The Enterprise
1© Copyright 2013 EMC Corporation. All rights reserved. EMC and Microsoft SharePoint Server Performance Name Title Date.
Office 365: Efficient Cloud Solutions Wednesday March 12, 9AM Chaz Vossburg / Gabe Laushbaugh.
Marginal Field Development Advances in 3D Geological Modeling: How it can help?
This presentation was scheduled to be delivered by Brian Mitchell, Lead Architect, Microsoft Big Data COE Follow him Contact him.
Page 1 © Hortonworks Inc – All Rights Reserved Hortonworks Naser Ali UK Building Energy Management Group Hadoop: A Data platform for businesses.
© 2011 IBM Corporation Smarter Software for a Smarter Planet The Capabilities of IBM Software Borislav Borissov SWG Manager, IBM.
SUBTITLE TEXT. Optimal Solutions What is E- Business Suite Oracle E-Business Suite is the most comprehensive suite of integrated, global business applications.
Big Data. What is Big Data? Big Data Analytics: 11 Case Histories and Success Stories
Charles Tappert Seidenberg School of CSIS, Pace University
Journey to a Real Time Enterprise
Creating New Business Value with Big Data Attivio Active Intelligence Engine®
MICROSOFT AZURE ISV PROFILE: D-SCOPE SYSTEMS D-Scope Systems is an enterprise-level medical media product and integration specialist company. It provides.
Big Data Analytics Large-Scale Data Management Big Data Analytics Data Science and Analytics How to manage very large amounts of data and extract value.
Solvoyo Answers the Weaknesses of Existing Supply Chain Planning Systems and Elevates Performance, with Help from the Powerful Microsoft Azure Cloud MICROSOFT.
Marv Adams Chief Information Officer November 29, 2001.
© 2012 IBM Corporation Converting Big Data into Big Knowledge.
What we know or see What’s actually there Wikipedia : In information technology, big data is a collection of data sets so large and complex that it.
IoT Meets Big Data Standardization Considerations
Axis AI Solves Challenges of Complex Data Extraction and Document Classification through Advanced Natural Language Processing and Machine Learning MICROSOFT.
BUSINESS INTELLIGENCE & ADVANCED ANALYTICS DISCOVER | PLAN | EXECUTE JANUARY 14, 2016.
LIMPOPO DEPARTMENT OF ECONOMIC DEVELOPMENT, ENVIRONMENT AND TOURISM The heartland of southern Africa – development is about people! 2015 ICT YOUTH CONFERENCE.
Built on the Powerful Microsoft Azure Platform, Forensic Advantage Helps Public Safety and National Security Agencies Collect, Analyze, Report, and Distribute.
Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.
Big Data Javad Azimi May First of All… Sorry about the language  Feel free to ask any question Please share similar experiences.
Dell Software Unified Communications Command Suite (UCCS) Provides Flexible, Cross-Platform Management, Reporting and Data Diagnostics MICROSOFT AZURE.
Data Analytics 1 - THE HISTORY AND CONCEPTS OF DATA ANALYTICS
AuraPortal Cloud Helps Empower Organizations to Organize and Control Their Business Processes via Applications on the Microsoft Azure Cloud Platform MICROSOFT.
Data Platform and Analytics Foundational Training
Data Platform Modernization
Big Data Enterprise Patterns
Meemim's Microsoft Azure-Hosted Knowledge Management Platform Simplifies the Sharing of Information with Colleagues, Clients or the Public MICROSOFT AZURE.
DocFusion 365 Intelligent Template Designer and Document Generation Engine on Azure Enables Your Team to Increase Productivity MICROSOFT AZURE APP BUILDER.
Microsoft Azure-Powered BlueCielo Meridian360 Portal Improves Asset Data Integrity and Facilitates Secure Collaboration with External Stakeholders MICROSOFT.
April 25, 2012 The Three R’s Are Old School – Now It Is All About Volume, Velocity & Variety Peter Guest Alberta Public Sector Client Technical Advisor.
Vidcoding Introduces Scalable Video and TV Encoding in the Cloud at an Affordable Price by Utilizing the Processing Power of Azure Batch MICROSOFT AZURE.
COMPANY PROFILE: COMPU CAMPO
NeoFirma Taps into the Microsoft Azure Cloud Platform to Deliver Digital Oilfield SaaS to North American Independent Oil and Gas Producers MICROSOFT AZURE.
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
Creating New Business Value with Big Data
© 2016 Global Market Insights, Inc. USA. All Rights Reserved Fuel Cell Market size worth $25.5bn by 2024Low Power Wide Area Network.
Hadoop Market
Get Real Value and Insights from Your Data: Biin Solutions Provides Predictive Analytics, IoT, and Business Intelligence with Microsoft Azure Power MICROSOFT.
H3 Solutions and the Azure Government Cloud Team Up to Power Contextual Intelligence Platform – Where Big Data Meets Business Productivity MICROSOFT AZURE.
MyHealthDirect’s Enterprise Scheduling Platform, Based on Microsoft Azure, Improves the Patient Experience and Reduces Patient Readmissions MICROSOFT AZURE.
Operationalize your data lake Accelerate business insight
Oscar AP by Massive Analytic: A Precognitive Analytics Platform for Effortless Data-Driven Decisions. Now Available in Azure Marketplace MICROSOFT AZURE.
Designed for Big Data Visual Analytics, Zoomdata Allows Business Users to Quickly Connect, Stream, and Visualize Data in the Microsoft Azure Platform MICROSOFT.
April 25, 2012 The Three R’s Are Old School – Now It Is All About Volume, Velocity & Variety Peter Guest Alberta Public Sector Client Technical Advisor.
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
Data Platform Modernization
DeFacto Planning on the Powerful Microsoft Azure Platform Puts the Power of Intelligent and Timely Planning at Any Business Manager’s Fingertips Partner.
Accelerate Your Self-Service Data Analytics
MyCloudIT Enables Partners to Drive Their Cloud Profitability Using CSP-Enabled Desktop Hosting Automation with Microsoft Azure and Office 365 MICROSOFT.
Carl Data Solutions Collects Utility Sensor and Meter Data to Provide Advanced Reporting, Alarming, and Analytics with Microsoft Azure MICROSOFT AZURE.
EnMS Polska Builds energyBIS on Microsoft Azure to Ensure a Scalable and Secure Energy Efficiency Monitoring and Management System MICROSOFT AZURE ISV.
One-Stop Shop Manages All Technical Vendor Data and Documentation and is Globally Deployed Using Microsoft Azure to Support Asset Owners/Operators MICROSOFT.
XtremeData on the Microsoft Azure Cloud Platform:
Improve Patient Experience with Saama and Microsoft Azure
Guarantee Hyper-V, System Center Performance and Autoscale to Microsoft Azure with Application Performance Control System from VMTurbo MICROSOFT AZURE.
SERVER INNOVATION ACCELERATES IT TRANSFORMATION
The Sense Add-On Module for MarineCFO’s Vessel 365 Solution Uses Microsoft Azure Services and IoT Technologies to Provide Advanced Data Analytics MICROSOFT.
Big Data Analysis in Digital Marketing
Big DATA.
COMPANY PROFILE: REELWAY
Built on the Powerful Azure Platform, Angoss Helps Businesses Turn Data into Actionable Insights That Reduce Risk, Increase Organizational Performance.
Presentation transcript:

11 THE BIG DEAL ABOUT BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES

Big Data Potential Defining Big Data and Analytics © IDC Energy Insights Visit us at IDC-ei.com 2 Big Data and analytics technologies describe a new generation of technologies and architectures designed to economically extract value from very large volumes of a wide variety of data (structured and unstructured) by enabling high-velocity capture, discovery, and/or analysis.

3 BUSINESS PROCESS DATABASE DATA BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze More Data with More Complex Relationships …in Real Time and At Scale To manage, govern and analyze 1X 10X 100X OLTP DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME

4 BIG DATA – THE PROMISE The Hype  Turning data flood into transformative insight  Exploration without preconceived notions The Reality  Big Data application stack is complex  Data is highly fragmented  New skill sets  Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video Web Logs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search Federation MPP Meta Data Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results?

5 BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains Track/train sensors Keep trains on schedule Proactive maintenance Telemetry from seismic sensors Time series data Operational data from sensors Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange High-speed index service 1/100 th faster

6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012 © BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012

7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY  60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source © BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012

Big Data Potential Volume, Velocity and Variety  More Volume Exploration: WAZ and IsoMetrix Drilling: Nuclear, electromagnetic, acoustic Production: Optical sensors  Potential Value Clearer view of potential resources Help guide a fracking process Show the way to enhancing production  More Velocity Real-time data from SCADA, drill heads, flow sensors, or condition sensors Stream vs. batch processing Complexity involving many engineering disciplines  Potential Value When consequences of failure are great When a delay in processing data may mean missing a bid for an oilfield © IDC Energy Insights Visit us at IDC-ei.com 8  More Variety Structured: Time series, relational Unstructured: CAD drawings, specifications, seismic, well log or daily drilling reports Semi-structured: Processed data  Potential Value Access data previously inaccessible due to multiple access patterns or unstructured nature of data

9 BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety Business Decisions E&P Investments Inventory locations Production planning Safety Petabyte to Real Time Unstructured Data

10 Growing data > 300 MB / Km 2 early 90s > 25 GB / km 2 in 2006 > Growing… to PBs / km 2  Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data  Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB  Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision VELOCITY – INGEST MORE DATA FASTER

11 VOLUME - INSATIABLE APPETITE FOR INFORMATION  Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances  Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source: Henri Calandra, John Etgen, Scott Morton – Rice University Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway.

12 VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas:  Many interconnected, increasingly complex and rapidly changing workflows  Exponential growth in the volume of data  Computational demands increasing by orders of magnitude  Manage complexity and increase efficiency  Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads

Big Data Potential Data Access Challenges  Data locked in applications on the desktop and cannot be shared efficiently  Legacy data that is in proprietary formats  Storage I/O requirements can still be a challenge. There may not be enough capacity or upload bandwidth.  The workloads may be random or sequential or both in an unpredictable pattern. © IDC Energy Insights Visit us at IDC-ei.com 13

14 UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS  Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop  One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency

15 OBRIGADO