We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byIvy Hooper
Modified about 1 year ago
© 2015 Ellen Friedman 1 Big Data Stories: Decisions That Drive Successful Projects Ellen Friedman Strata Conference San Jose 18 February 2015
© 2015 Ellen Friedman 2 Contact Information Ellen Friedman Solutions Consultant and Commentator Apache Mahout committer, Apache Drill contributor Email email@example.com@apache.org firstname.lastname@example.org Twitter @Ellen_Friedman@ApacheDrill Hashtag today: #StrataHadoop
© 2015 Ellen Friedman 3 Data Driven Decisions What lies behind successful projects?
© 2015 Ellen Friedman 4 “My best decision, really, was to make time to think.” Camille Fournier Head of Engineering, Rent-the-Runway Committer, Apache Zookeeper project quote from her blog post 6 Dec 2014 bit.ly/camille-best-decision @skamille
© 2015 Ellen Friedman 5 Set aside time to think… … you may be surprised at what occurs to you. © 2014 Ellen Friedman
© 2015 Ellen Friedman 6 Decision 1: Make time to think
© 2015 Ellen Friedman 7 Decision 2: Listen to your data (make sure it’s good data)
© 2015 Ellen Friedman 8 Oddly, that’s where his real adventure starts. Matthew Fountain Maury was a sailor in the 1830s. Injured his leg, so the US Navy gave him a “desk job”.
© 2015 Ellen Friedman 9 Big data project: Maury’s Wind and Currents charts At first, no body was interested in them… …until Captain Jackson shaved a month off the run from Baltimore to Rio de Janeiro
© 2015 Ellen Friedman 10 Decision 3: Transform your thinking
© 2015 Ellen Friedman 11 Big Data Technologies What about Apache Hadoop & NoSQL technology?
© 2015 Ellen Friedman 12 It isn’t magic and you don’t just plug it in… $ $ $ $ $
© 2015 Ellen Friedman 13 Working with Apache Hadoop and NoSQL databases The need to transform thinking: You’re not stuck with your first decisions – learn to take advantage of flexibility Save more data and save it longer Explore new data sources and new formats Combine data sources for more powerful insights
© 2015 Ellen Friedman 14 “Technology is a tool. People solve problems.” John Omernick VP Big Data Analytics & Manager of Fraud Center of Excellence at Zions Bancorporation quote from personal communication 4 Feb 2015
© 2015 Ellen Friedman 15 Decision 4: Recognize that people solve problems
© 2015 Ellen Friedman 16 Decision 5: Be realistic about goals & SLAs
© 2015 Ellen Friedman 17 What if you needed to uniquely identify every person in India? All 1.2 billion of them….
© 2015 Ellen Friedman 18 PEOPLE Aadhaar Project: Largest Biometric DB in the World Unique 12 – digit number for each person in India Proof of identity, authenticated anytime, anywhere Runs on NoSQL database MapR-DB 1.2 B PEOPLE
© 2015 Ellen Friedman 19 What does Aadhaar mean for India? Better delivery of welfare services More open society –Identification without regard to cast, creed, religion or geography Reduction in embezzlement – save billions in government funds
© 2015 Ellen Friedman 20 A Day in the Life of the Aadhaar Project Data platform must handle: 1 million new enrollments /day –After 4 years, ~ 700 million of the 1.2 billion already enrolled –4+ PB of raw data Each new enrollment needs de-duplication –100s of millions of transaction over billions of records doing 100s of trillions of biometric matches/day Online sub-second authentications, anytime, anywhere –as many as 100 million per day –Runs on MapR data platform’s NoSQL database (MapR-DB) Official website of Unique Identification Authority of India (UIDAI) http://uidai.gov.in
© 2015 Ellen Friedman 21 Decision 6: See performance as more than a sprint
© 2015 Ellen Friedman 22 Decision 7: Recognize common design patterns that cross verticals
© 2015 Ellen Friedman 23 Design patterns for solutions cut across verticals Example: Anomaly detection well known technique for finding fraud and security breaches such as in the financial sector But anomaly detection is also useful to understand sporadic web traffic, which is useful for online marketing
© 2015 Ellen Friedman 24 Believe your data: Discover instead of define Anomaly detection done well has a common theme: First make an adaptive model to discover what is normal, then you can recognize outliers with anomalous behavior.
© 2015 Ellen Friedman 25 Communication matters…
© 2015 Ellen Friedman 26 Decision 5: Look for basic concepts & the big picture
© 2015 Ellen Friedman 27 Think beyond individual use cases…
© 2015 Ellen Friedman 28 Decision 8: Think in terms of new approach across organization
© 2015 Ellen Friedman 29 “Let go of your fear of failure.” Mike Brown CTO, comScore Quote from personal communication, January 2015
© 2015 Ellen Friedman 30 Decision 9: Create safe setting for experimentation
© 2015 Ellen Friedman 31 Decision 10: Future proof your org by building experience
© 2015 Ellen Friedman 32 Please support women in tech – help build girls’ dreams of what they can accomplish © Ellen Friedman 2015
© 2015 Ellen Friedman 33 Real World Hadoop by Ted Dunning and Ellen Friedman © Feb 2015 (published by O’Reilly) eBook courtesy of MapR: http://bit.ly/mapr-real-world-hadoop
© 2015 Ellen Friedman 34 Real World Hadoop by Ted Dunning and Ellen Friedman © Feb 2015 (published by O’Reilly) Free print copy during book signings at MapR booth Today 5:15 pm Thur 5:30 pm Fri10:10 am
© 2015 Ellen Friedman 35 Related events at Strata this week: “Real World Use Cases: Hadoop and NoSQL in Production” Ted Dunning & Ellen Friedman Thur 19 Feb 2015 at 10:40am http://bit.ly/hadoop-use-cases Office hour Ellen Friedman Thur 19 Feb 2015 at 11:30 am Plus news of Myriad: new OSS collaboration for global resource management: “YARN vs. Mesos: Can’t We All Just Get Along” Ted Dunning Fri 20 Feb 2015 at 2:20pm http://bit.ly/strata2015-myriad
© 2015 Ellen Friedman 36 Contact Information Ellen Friedman Solutions Consultant and Commentator Apache Mahout committer, Apache Drill contributor Email email@example.com@apache.org firstname.lastname@example.org Twitter @Ellen_Friedman@ApacheDrill Hashtag today: #StrataHadoop
© 2014 MapR Technologies 1 Ted Dunning February 20, 2015.
Getting Found Online: How to LEVERAGE Blogging to Grow Your Business & Your BOTTOM LINE! Presented by Heidi Richards Mooney Redhead Marketing Inc.
Boosting your journals presence through social media.
Hi, how may we help you? New business / start-up Grow an existing business Get Active with Social Media Online Booking MiQuando.
Public Relations & Social Media. Public Relations What is.
From SEO to “SEE” Carmen Cano April, 2012 …does it make a sound?" "If a tree falls in a forest and no one is around to hear it…
The Aadhaar project Unique Identity and Its Positive Externalities for Inclusiveness 16 th January 2013 UIDAI
© 2014 MapR Technologies 1 Ted Dunning. © 2014 MapR Technologies 2 Me, Us Ted Dunning, MapR Chief Application Architect, Apache Member –Committer PMC.
Biometrics Authentication Technology Submitted By: Navin Kumar 09EAXEC075.
How to Use Social Media for Business Part One: What is Social Media and Why Should I Care.
© 2012 Datameer, Inc. All rights reserved. Page 1 © 2012 Datameer, Inc. All rights reserved. Hadoop in Financial Services Adam Gugliciello, Solutions Engineer.
GOING GLOBAL? A brief outline of events that have shaped the global economy The World is Flat by Thomas L. Friedman.
Simple Online Accounts for Your Business – With Help from Microsoft Azure, Big Red Cloud Makes Accounting Easier for Thousands of Businesses MICROSOFT.
Information Literacy Defined A set of abilities that requires individuals: recognize what information is needed have the ability to locate, evaluate,
The Waterless Pro Zone with Steve “DUKE” Wolshin of Kauai Auto Detail.
BIG DATA A Revolution That Will Transform How We Live, Work, and Think Niko Sipola CT60A Critical Thinking and Argumentation in Software.
Traffic is the next module We're now going to hold One module a week One interactive session a week One brainstorm session a week.
Mrs. Jowers’ Class News August 14, Mrs. Jowers’Class News Sept. 25, 2015 Oh my goodness! I can’t believe that I will be writing an October newsletter.
Denise Archie and Marcus Archie Joins Dori Mintzer from Boomers and Beyond with a surprise guest: World Leader in Social Media Wayne Mansfield presents.
Student Senate HOW TO CLAIM YOUR ALLOCATIONS AND SUPPLEMENTAL FUNDING.
Club Alliance General Body Meeting November 14th.
AAB Service Updates August 5, Service Topics and Updates ●Critical dimensions of service and getting ready for start of term ●Colleges and Salesforce.
Use of Aadhaar Card to facilitate the process of Job and Admission Applications. Use of Aadhaar Card to enforce Pollution Checks on vehicles. Use.
Web 2.0: Making the Web Work for You - Illustrated Unit C: Collaborating and Sharing Information.
Warren County Middle School Business and Information Technology Program IC 3 Certification Program 2 Year Progress Report.
Unlock your Big Data with Analytics and BI on Office365 Brian Culver ● SharePoint Fest Seattle● BI102 ● August 18-20, 2015.
Using Social Media at an Advanced Level John Dawe, CFRE Dawe Consulting, LLC facebook.com/johndawe.
Granite Referral System Helping Your Customers Find You Online! Presenter: Type Your Name Here BMGA Executive.
Marketing Your Business Through Social Media. FSC Interactive Online and Interactive Marketing Agency located in New Orleans, La. Specialize in Social.
IFAP and Schools Portal: Tips, Tricks and Techniques. Marcello Rojtman Presenter Session 37B.
Offline & Online Marketing Go Hand in Hand. What?! Not Everything Involves the Web??
Social Networking: Facebook, Twitter, and Google+ Mary Rotman Publicist, O’Reilly Media.
Trusted evidence. Informed decisions. Better health. Brand webinar We will start in a few minutes…
Please feel free to chat until the seminar begins at the top of the hour!
Facebook Fundamentals Debbie Harris. Some Quick Facebook Stats Global Audience 838,198,660 U.S. Audience 156,820,080 Female Audience U.S. 55% 85,334,520.
Social Media at LISC June LISC Social Media What is it? New ways to distribute our news and stories that engages, interacts and shares. Why do it?
Free Webtools for the 21 st Century Learner Lori Martinez Singleterry Elementary & Daniela I. Guardiola, M.Ed. Librarian/MTT.
PLEASE READ THE NOTES! Important information and instructions are provided in the Notes section of the slides.
The EDGE Information and news that gives you an edge in the real estate business In This Week’s “The EDGE” Houston Home Sales Off Slightly in January Will.
Evaluating Web Resources Hosted by Lee Anne Morris.
Inbound Statistics Slides Template Resources for Partners.
30 Tips in 30 Minutes Marketing Your Event on Social Media.
Insurance Coordinator Survey Comments and Suggestions Comments and Suggestions Given by Insurance Coordinators on the Spring Training Survey.
Going where consumers are!
Digital Publishing in the 21 st Century Challenges and opportunities James McCall Principal Consultant in International Publishing Scottish Centre for.
Welcome to Training Day Detroit High School Journalism Program
Fundamentals of Migrating Content to AEM. We will be covering.. Principle of Content Migration Key Differences between Manual and Automated.
Sometimes you quoted directly: Harry Henderson says, “Out of this torrent of stories, all delivered in about the same tone of importance, it has become.
Club Info Meeting Rosendo Anguiano Sainz, ASB VP & Club Rep Kyle Ferguson, ASB Treasurer.
Xenomorph ® Transforming Data Management. Accelerating Data & Analytics Management Author: Brian Sentance, CEO, Xenomorph Date: 6 th October 2008 Presented.
© 2017 SlidePlayer.com Inc. All rights reserved.