We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byLandon Kempson
Modified about 1 year ago
THE DATA LAKE DREAM Edd Dumbill @edd firstname.lastname@example.org svds.com/StrataNY2014
2 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
3 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. A scalable, accessible repository of data (in its natural or processed state) WHAT IS A DATA LAKE?
4 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. CLEANVALIDATECONTROLPROTECT CONVENTIONAL DATA STRATEGY “WHAT YOU DO TO DATA”
5 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. MODERN DATA STRATEGY “WHAT YOU DO WITH DATA” TARGET VIP CUSTOMERS ATTRACT NEW CUSTOMERS AUTOMATE
6 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
7 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. TOWARDS THE “DATA LAKE” — Step 1
8 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. TOWARDS THE “DATA LAKE” — Step 2
9 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. TOWARDS THE “DATA LAKE” — Step 3
10 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. TOWARDS THE “DATA LAKE” — Step 4
11 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. UP vs. OUT — Enterprise Edition Different use cases put different demands on the data infrastructure. Increasing cost per unit of capability from scale- up architectures causes rationing of resources. Only the most valuable use cases are pursued. US Dollars Data Resource Usage Scale-up cost Scale-out cost UC1 UC2 UC3 UC4 UC5
12 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. THE DATA VALUE CHAIN DRAW VALUE FROM YOUR STRATEGIC DATA ASSETS Discover Ingest Process Persist Integrate Analyze Expose
1313 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. Make it cheap Failure as a feature Ask good questions Make it quick Both learning and adaptation Enable the feedback loop Don’t break things Make operations a platform for innovation APIs, platforms, simulation BUILD FOR EXPERIMENTS
14 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. THE EXPERIMENTAL ENTERPRISE We need to both support investigative work and build a solid layer for production. Data science allows us to observe our experiments and respond to the changing environment. The foundation of the experimental enterprise focuses on making infrastructure readily accessible.
15 Edd Dumbill email@example.com@edd@SVDataScience Yes, we’re hiring! firstname.lastname@example.org Want these slides? Go to: svds.com/StrataNY2014
IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd svds.com/StrataUK2015.
USING MULTIPLE PERSISTENCE LAYERS IN SPARK TO BUILD A SCALABLE PREDICTION ENGINE Richard Williamson
© 2010 Cisco and/or its affiliates. All rights reserved. 1 Managing Microsoft Applications with Cisco UCS Manager & PowerTool.
Cisco Consulting Services for Application-Centric Cloud Your Company Needs Fast IT Cisco Application-Centric Cloud Can Help.
Judith Hurwitz President & CEO The Movement Towards a Service Oriented Architecture.
Joe Caserta President Elliott Cordo Chief Architect September 30, 2015, Javits Center, New York City Building a Data Lake for Digital Music Dominance.
Elena Iancu. … describe future targets and the means to achieve them … describe future targets and the means to achieve them … facilitate collaboration,
JUNE 2007 page 1 EDS Proprietary Applications Modernization Services Modernizing the Applications Portfolio.
Chapter 4 Investigating and Determining System Requirements.
T8. Open Source Tools That are Changing the Content Technology Landscape Gilbane San Francisco 2010.
Service Catalog Self Service Elasticity Provisioning Chargeback Standardization Security Elasticity Flexibility Integration Economies of Scale.
DEVELOPING A BUSINESS ARCHITECTURE STRATEGY Sarat Varanasi & Praveen Desai.
Wellstorm WSP: Enterprise Drilling Information Wellstorm Development Hugh Winkler CTO.
1 Adopting and Embracing Open Source for NFV Guy Shemesh Senior Director for Cloud Solutions, CloudBand October 2015.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Migrating your Data.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Confidential 1 MAP Value Proposition.
Advanced Persistent Threat Protection For Dummies Special Edition 1 © 2013 Seculert Company, All Rights Reserved.
Plumbing the Computing Platforms of Big Data Dilma Da Silva Professor & Department Head Computer Science & Engineering Texas A&M University.
Networks ∙ Services ∙ People Sonja Filiposka, Yuri Demchenko, Tasos Karaliotas, Migiel de Vos, Damir Regvart TNC 2016 DISTRIBUTED CLOUD SERVICES.
1 Towards a common statistical enterprise architecture Ongoing process reengineering at Statistics Sweden Service Oriented Architecture – SOA Sharing of.
Esri UC 2014 | Technical Workshop | Automating Cache Workflows and Tile Usage Heat Maps Eric J. Rodenberg.
©2013 Microsoft Corporation. SharePoint Innovations LLC. All rights reserved. M ODULE 13 – S HARE P OINT 2010 O VERVIEW OF S HARE P OINT 2013.
The FI-WARE Project – Base Platform for Future Service Infrastructures NOVEMBER, 16th 2011Thierry Nagellen Workshop AAL Community.
DEV 303 Visual Studio "Whidbey" Enterprise Tools: Source Control and Work Item Tracking Brian Harry Product Unit Manager Microsoft Visual Studio.
CHAPTER 3 INTERNAL ANALYSIS: DISTINCTIVE COMPETENCIES, COMPETITIVE ADVANTAGE, AND PROFITABILITY.
Innovation Tools: Innovation Dashboard & Opportunity Assessment Templates.
© 2009 IBM Corporation Getting Smarter with Information An Information Agenda Approach Damiaan Zwietering Information Architect
Building an Operational Enterprise Architecture and Service Oriented Architecture Best Practices Presented by: Ajay Budhraja Copyright 2006 Ajay Budhraja,
PREPARED BY: Hadeel El-Genedy SOFTWARE ARCHITECTURE COURSE PRE-MASTERS STUDIES COMPUTER SCIENCE DEPARTMENT CAIRO UNIVERSITY Software Product Line.
MDS Global IT Strategy Discussion July 7, Agenda IntroductionErnest Strategic directionsGanesh DiscussionAll Next stepsErnest.
Aligning Business Process Architecture and Enterprise Architecture: A Model Driven - Service Oriented Approach Chris Capadouca Business Solutions Architect.
Integration Patterns: Matching Requirements to Solutions Beth Gold-Bernstein VP Strategic Services, ebizQ.
Supporting New Business Imperatives Creating a Framework for Interoperable Media Services (FIMS)
Nicolas Fonrose (Valtech) VISP – Virtual Internet Service Provider What, Why, Business context, Technical solutions chosen This presentation reflects only.
Copyright 2009 Fujitsu America, Inc. 0 Fujitsu PRIMERGY Servers “Next Generation HPC and Cloud Architecture” PRIMERGY CX1000 Tom Donnelly April
Declarative Configuration Management with Azure Automation DSC and ARM Nathan Lasnoski Vice President of blog.concurrency.com Concurrency.
Applying the SOA RA Utah Public Safety ESB Project Utah Department of Technology Services April 10, 2008 Prepared by Robert Woolley.
Media Asset Management Done Correctly. Cantemo Portal™ Editions Cantemo Portal™Cantemo Portal™ Enterprise UsersUp to 60Unlimited AssetsUp to 1MUnlimited.
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
Cloud Computing Security With More Than 50 Years Of Security And Enterprise Experience Cloud Raxak Automating Cloud Security. Cloud Raxak automates and.
Rob Byrd Chief Enterprise Architect Enterprise Architecture – A Citywide Service Delivery Strategy Aligning Information Technology Services to the Citizen.
Innovation is not only new product features... Business model How the enterprise makes money Networking Enterprise structure/value chain Enabling process.
Portal for ArcGIS An Introduction Derek Law July 22, 2015.
Copyright © Ciena Corporation All rights reserved. Confidential & Proprietary. Different by design Simon Parry 13 th September 2013 Creating networks.
The FI-WARE Project – Base Platform for Future Service Infrastructures FI-WARE OCTOBER 2011 Presentation at proposers day.
Systems Design Approaches The Waterfall vs. Iterative Methodologies.
Copyright © 2012, SAS Institute Inc. All rights reserved. SAS GRID OPUS SPRING 2014 MEETING FRANK SCOTT, SAS CANADA.
Ýmir Vigfússon IBM Research Haifa Labs Ken Birman Cornell University Qi Huang Cornell University Deepak Nataraj Cornell University.
Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Platform Computing Ken Hertzler VP Product Management.
© 2017 SlidePlayer.com Inc. All rights reserved.