Presentation is loading. Please wait.

Presentation is loading. Please wait.

SM STRATA PRESENTATION Tim Garnto - SVP Engineering, edo Interactive Rob Rosen – Big Data Field Lead, Pentaho.

Similar presentations


Presentation on theme: "SM STRATA PRESENTATION Tim Garnto - SVP Engineering, edo Interactive Rob Rosen – Big Data Field Lead, Pentaho."— Presentation transcript:

1 SM STRATA PRESENTATION Tim Garnto - SVP Engineering, edo Interactive Rob Rosen – Big Data Field Lead, Pentaho

2 HELLO.

3 3 Proprietary and Confidential, edō Interactive, Inc. ABOUT Full-Spectrum Analytics Platform Open Source Heritage: Founded in 2004 Over 10,000 Production Customers Spanning 185 Countries Certified Interoperability with Widest Variety of Data Sources: Hadoop NoSQL Traditional Structured Datasets

4 4 Proprietary and Confidential, edō Interactive, Inc. SIMPLIFIED ANALYTICS FOR ALL USERS ANY Analytics Reports Dashboards Visualizations Discovery Predictive Analytics ANY Environment Data warehouses Data marts Stack vendors Cloud Embedded Existing & New Data Infrastructure & Processes ANY Data Relational Operational Big Data Data sources not yet anticipated… Billing Location Social Media Customer Web Network

5 5 Proprietary and Confidential, edō Interactive, Inc. EDO MISSION We’re transforming shopping and saving with the simplest solution to find merchants new customers with personalized offers available on consumer debit and credit cards

6 6 Proprietary and Confidential, edō Interactive, Inc. OUR STORY Founded in 2007 & Venture-backed Defining the intersection of payments & advertising Co-headquartered in Nashville and Chicago 2014 Brill Street Top 50 Employer MAKING SHOPPING & SAVING SIMPLE

7 7 Proprietary and Confidential, edō Interactive, Inc. ECOSYSTEM 3 of the top 6 financial institutions 200+ Enrolled Banks Total reach of 200 million cards 1000+ Retailers and Restaurants Leading National Brands Local Community Businesses Banks and Issuers Advertisers

8 BUSINESS INTELLIGENCE

9 9 Proprietary and Confidential, edō Interactive, Inc. ISSUE First generation BI platform was built on traditional data warehouse star schema Business growth was constrained by platform scalability Warehouse build was not always completing resulting in stale data Data volumes quickly caused analytics and offer processing to extend beyond 24 hours to launch offers Total data volumes increasing with new partners and increased adoption Slow development cycle to generate new reports/insights/etc…

10 10 Proprietary and Confidential, edō Interactive, Inc. SOLUTION APPROACH Implement Cloudera Hadoop Migrate data processing, analytic processing and offer assignment to use tools Leverage Pentaho Big Data capabilities Accelerate adoption with external help - OpenBI

11 11 Proprietary and Confidential, edō Interactive, Inc. IMPLEMENTATION PROCESS Step 1 - Transitioned from Traditional Warehouse to Hadoop using same processes and queries Step 2 – Optimize queries and processes for Hadoop in Pentaho Step 3 – Update processes to use Map/Reduce and Pig from within Pentaho

12 12 Proprietary and Confidential, edō Interactive, Inc. OUR BI PLATFORM

13 13 Proprietary and Confidential, edō Interactive, Inc. OUR DATA PIPELINE

14 14 Proprietary and Confidential, edō Interactive, Inc. ANALYTICS AND OFFERS

15 15 Proprietary and Confidential, edō Interactive, Inc. CONFIGURATION Total Size Nodes20 Cores480 Memory1.9 TB Storage255 TB Node Profile Cores24 Memory96 GB Storage12 TB 24 TB Versions Cloudera Manager 4.8.0 CDH 4.5.0 Impala 1.2.3 Hadoop-LZO 0.3.15 Pentaho 5.0.3

16 RESULTS

17 17 Proprietary and Confidential, edō Interactive, Inc. DATA GROWTH

18 18 Proprietary and Confidential, edō Interactive, Inc. PROCESSING RESULTS Daily Warehouse Loads Analysis and Offer Process

19 19 Proprietary and Confidential, edō Interactive, Inc. FINAL THOUGHTS Pentaho Big Data Capabilities allowed edo to quickly move to Hadoop Pentaho Map/Reduce and Pig Steps allow deeper integration through familiar workflow Pentaho Analyzer with Impala is fast reporting against billions of rows

20 THANK YOU edointeractive EdoInteractive


Download ppt "SM STRATA PRESENTATION Tim Garnto - SVP Engineering, edo Interactive Rob Rosen – Big Data Field Lead, Pentaho."

Similar presentations


Ads by Google