Download presentation
Presentation is loading. Please wait.
Published byPreston Gilmore Modified over 9 years ago
1
SM STRATA PRESENTATION Tim Garnto - SVP Engineering, edo Interactive Rob Rosen – Big Data Field Lead, Pentaho
2
HELLO.
3
3 Proprietary and Confidential, edō Interactive, Inc. ABOUT Full-Spectrum Analytics Platform Open Source Heritage: Founded in 2004 Over 10,000 Production Customers Spanning 185 Countries Certified Interoperability with Widest Variety of Data Sources: Hadoop NoSQL Traditional Structured Datasets
4
4 Proprietary and Confidential, edō Interactive, Inc. SIMPLIFIED ANALYTICS FOR ALL USERS ANY Analytics Reports Dashboards Visualizations Discovery Predictive Analytics ANY Environment Data warehouses Data marts Stack vendors Cloud Embedded Existing & New Data Infrastructure & Processes ANY Data Relational Operational Big Data Data sources not yet anticipated… Billing Location Social Media Customer Web Network
5
5 Proprietary and Confidential, edō Interactive, Inc. EDO MISSION We’re transforming shopping and saving with the simplest solution to find merchants new customers with personalized offers available on consumer debit and credit cards
6
6 Proprietary and Confidential, edō Interactive, Inc. OUR STORY Founded in 2007 & Venture-backed Defining the intersection of payments & advertising Co-headquartered in Nashville and Chicago 2014 Brill Street Top 50 Employer MAKING SHOPPING & SAVING SIMPLE
7
7 Proprietary and Confidential, edō Interactive, Inc. ECOSYSTEM 3 of the top 6 financial institutions 200+ Enrolled Banks Total reach of 200 million cards 1000+ Retailers and Restaurants Leading National Brands Local Community Businesses Banks and Issuers Advertisers
8
BUSINESS INTELLIGENCE
9
9 Proprietary and Confidential, edō Interactive, Inc. ISSUE First generation BI platform was built on traditional data warehouse star schema Business growth was constrained by platform scalability Warehouse build was not always completing resulting in stale data Data volumes quickly caused analytics and offer processing to extend beyond 24 hours to launch offers Total data volumes increasing with new partners and increased adoption Slow development cycle to generate new reports/insights/etc…
10
10 Proprietary and Confidential, edō Interactive, Inc. SOLUTION APPROACH Implement Cloudera Hadoop Migrate data processing, analytic processing and offer assignment to use tools Leverage Pentaho Big Data capabilities Accelerate adoption with external help - OpenBI
11
11 Proprietary and Confidential, edō Interactive, Inc. IMPLEMENTATION PROCESS Step 1 - Transitioned from Traditional Warehouse to Hadoop using same processes and queries Step 2 – Optimize queries and processes for Hadoop in Pentaho Step 3 – Update processes to use Map/Reduce and Pig from within Pentaho
12
12 Proprietary and Confidential, edō Interactive, Inc. OUR BI PLATFORM
13
13 Proprietary and Confidential, edō Interactive, Inc. OUR DATA PIPELINE
14
14 Proprietary and Confidential, edō Interactive, Inc. ANALYTICS AND OFFERS
15
15 Proprietary and Confidential, edō Interactive, Inc. CONFIGURATION Total Size Nodes20 Cores480 Memory1.9 TB Storage255 TB Node Profile Cores24 Memory96 GB Storage12 TB 24 TB Versions Cloudera Manager 4.8.0 CDH 4.5.0 Impala 1.2.3 Hadoop-LZO 0.3.15 Pentaho 5.0.3
16
RESULTS
17
17 Proprietary and Confidential, edō Interactive, Inc. DATA GROWTH
18
18 Proprietary and Confidential, edō Interactive, Inc. PROCESSING RESULTS Daily Warehouse Loads Analysis and Offer Process
19
19 Proprietary and Confidential, edō Interactive, Inc. FINAL THOUGHTS Pentaho Big Data Capabilities allowed edo to quickly move to Hadoop Pentaho Map/Reduce and Pig Steps allow deeper integration through familiar workflow Pentaho Analyzer with Impala is fast reporting against billions of rows
20
THANK YOU edointeractive EdoInteractive
Similar presentations
© 2024 SlidePlayer.com Inc.
All rights reserved.