Marketing Attribution Problematic September 2012 Extract from various presentations: RPM Direct, Kevin Hillstrom, Teradata Aster, …

Mail TV Print TM QuoteTM Sale Marketing Channels and Attribution

Marketing Channels and Attribution Aggregator Web Quote Mail TV Print Banner Search TM QuoteTM Sale Web Sale

Marketing Channels and Attribution Aggregator Web Quote Mail TV Print Banner Search TM QuoteTM Sale Web Sale

Marketing Channels and Attribution Aggregator Web Quote Mail TV Print Banner Search TM QuoteTM Sale Web Sale

Putting Response in Correct “Bucket” Putting Sales in Correct “Bucket” Calculating Media Cost per Sale Spending Next Tactical Marketing Dollar Building Media Specific Targeting Models Making Strategic Business Decisions Marketing Channels and Attribution

Channel Attribution Methodology Individual Customer Identification Numbers Marketing Source Codes Name and Address Match Factor Analysis Dynamic Time Series Regression Proportionately “Factor” Leftovers into Marketing Channels

What is a latent conversion

What’s wrong with Google Analytics? n ROI is attributed to the last (latent) referrer (Most recent keyword, ad, , blog etc.) What’s wrong with most recent? –Shoppers initiate search using broad categories –Later narrow down to product names/IDs –Perhaps then narrow to store brand n Broad categories don’t get the credit they (may) deserve n The only exception is direct type-in n Google Analytics takes the blame, though many web analytics tools work the same in a default implementation

Attribution examples Quiz: An existing customer receives a catalog on September 1. On September 2, the customer uses Google to search for merchandise, visits your website, and purchases an item. What % of the order do you allocate to catalogs, to search, and to organic brand loyalty? Quiz: An existing customer receives a catalog on September 1, receives marketing campaigns on September 7 and September 9, and purchases on your website on September 10, buying merchandise featured in your catalog and merchandise available only online. What % of the order do you allocate to catalogs, e- mail, and to organic brand loyalty? Quiz: An existing customer receives a catalog on August 1, and receives 17 marketing messages between 8/1 and 10/1. On 10/4, the customer uses Google to search for merchandise, visits, and buys an item. What % of the order do you allocate to catalogs, to , to search, and to organic brand loyalty?

Test + Results = Attribution Rules The beautiful thing about catalog marketing and marketing is that you can test, you can see what happens to other channels when you do not mail a catalog, when you do not send an campaign! Sample 80,000 twelve-month buyers with a valid address. Group 1 = 20,000: Catalogs = Yes, = Yes Group 2 = 20,000: Catalogs = Yes, = No Group 3 = 20,000: Catalogs = No, = Yes Group 4 = 20,000: Catalogs = No, = No Execute for a month, quarter, season, or year! In a controlled experiment, the results of your test tell you what impact catalog marketing and marketing have on other channels (search, mobile, social, display ads, affiliates), so you can set up reasonable attribution rules!

Some Results We have four test panels in this test. We sent one catalog and nine e- mail campaigns during a one-month timeframe

What Is The Organic Percentage? The organic percentage is possibly the most important metric a direct marketer / catalog brand can track. It is the percentage of demand that will be generated if no marketing exists. What about our example? 13 Take the $5.80 generated in the no catalogs / no test panel, and divide it by the $11.37 generated in the catalogs + test panel. The result is 51%.

A 51% Organic Percentage We must execute catalog and mail/holdout test panels, in order to properly estimate what our organic percentage is. When the organic percentage is < 20%, your matchback/allocation process is generally accurate. When the organic percentage is > 40%, matchbacks and allocation programs become increasingly inaccurate. Does The Organic Percentage Vary? Some customers are “highly organic”, while other customers require “large amounts of marketing”. There are HUGE profit opportunities in knowing this difference! Customers who mail orders to a company or use the telephone to order require advertising. Customers who combine catalogs and online channels are a “hybrid”, requiring much less advertising. Customers who order online or in stores are highly organic, you can reduce advertising!

Key Takeaways Have the courage to execute both catalog mail/holdout tests and mail/holdout tests. Test four panels, test for a quarter or season or year if you can. The results are going to be breathtaking!. Catalogs: In many cases, orders that would have happened anyway are attributed to catalogs, causing us to spend way too much money mailing catalogs. is frequently cannibalized by catalogs. frequently causes Search/Mobile orders to happen. Search: Search is often the outcome of catalog marketing or marketing. Social/Mobile: In the early stages of a channel, sales are frequently cannibalized from existing channels, or the existing channels cause the sale to happen in the new channel. Over time, new channels become “organic”, and do not require old- school channels in order to create sales on their own. Tests can validate this.

Multi-Channel Customer Analysis Business Question(s): Prior to new product additions? Is there any identifiable pattern of behavior prior to account closure? If so, what does this pattern look like?

Value of Aster Data for Digital Marketing Aster Data Analysis Click-stream # of visitors, visitor location, browser type Last click analysis Online behavior Common interaction behaviors Optimal paths through website A/B testing Where to place this button, link, etc. Search Optimization Mix of paid per click and organic Which search terms drive traffic, behaviors Advertising Optimization Conversion How to optimize advertising placement Where are shopping carts abandoned & why Marketing Attribution What % credit to give each referring channel or campaign + Teradata Adds… Multi-channel (online & offline) campaign analysis -Complete customer interaction history Marketing return on investment -Attribution + cost of conversion + Aprimo Adds… Campaign management -Take action to influence behaviors Marketing Resource Management -Take action to optimize marketing spend

Attribution Using Aster

Prepares multi-structured data Stitches rows together by customer in a time-ordered view Scans all records to produce a complete set of paths No need to define patterns in advance Fully parallelized for top performance using MapReduce where SQL falls down Summarize output for business exploration Rank order the most popular paths and yet represent the long tail too Aster nPath Identifies the “Last Mile” All interaction patterns evaluated in a single pass Step 2: Run nPath SQL- MapReduce Java Logic Total # of Customerschannel1…channeln 35Online Retail…Research products 26Store Purchase…BankX Credit Card custIDchannel1…channelntime1…timen 10001Online Retail…Research products 12:00 PM 1/1/2010 …3:00 PM 2/15/ Store Purchase…BankX Credit Card 1:45 PM 1/1/2010 …12:20 PM 2/22/2010 Step 1: Pivot data via nPath SQL-MapReduce userIDeventtime userIDeventtime Aster MapReduce Platform

Aster nPath example: Account Closure