Thursday 23 February 2012

Advanced Multi-Channel Funnel Analysis using Google Analytics

Advanced-Multi-Channel-Funnel-Analysis-using-Google-Analytics
Multi-Channel Funnel has been in Google Analytics for a while. Although by searching "Multi-Channel Analysis" you could find a lot of great how-to articles to leverage this powerful function, but seldom of them have explored the opportunities in using it for better resources allocation decision based on ROI estimation, particularly, using Assisted Conversions. Hence, i have decided to put together my experience in marketing, analytic, and infographic to demonstrate the following analytic model. Enjoy.

(Disclosure: i am currently working at MRM Worldiwide, a Digital Strategy agency under McCann WorldGroup, and hopefully the following model will be used in our service someday.....so........ have fun ! XD)




A Closer Look to Assisted Conversion


Apart from the Multi-Channel Funnel view in Google Analytics, Assisted Conversion Report is the one that we are looking for. If you have some experience in Omniture, you would know that Assisted Conversion is indeed having similar logic as Participation Variable, a way to estimate the potential value that a particular entity, exists within a funnel of process, has driven. For example, if a visitor purchase a dress online after she visit a review on a forum (outside the eshop), both our eshop and the external forum will be entitled to have contributions, in terms of conversions and revenue, counted towards themselves, either evenly (all entities have the same value) or linearly (all entities gain the average of value gained, only in Omniture), demonstrating that how the entity "participate" within the whole conversion path.

A snapshot of Assisted Conversion Report of my groupbuying site: Cheapppy

....


What makes Multi-Channel Funnel in Google Analytics more powerful (than Omniture) is, it has segmented that participation value for you, based on whether that entity, in the above graph would be "Channel", has contributed as the Last Interaction or not. Should that channel is not the last step before the visitor being converted, then it's "assisting" the conversion flow, and that counts towards as their Assisted Conversions instead.

The power behind this logic is the different between Assisted Conversion and Last Interactions Conversion. Traditionally we count conversion towards the "last stop" of visitors, but with the uprising of Social Media, where fans usually "engage" and "consider" rather than "converted", increases the complexity of the tradition conversion path as well as the evaluation process. Google does this tedious work for you, by introducing the Assisted Conversion, it is easier for analyst to tell if certain channels are good enough to support the conversion flow despite that they might not be the "last stop" of visitors. To make this concept even more clear, Google introduce the "Assisted / Last Interaction Conversions (Ratio)" which tells whether a channel could drive more Assisted or Last Interaction Conversions (>1 = "contribute more within the flow", <1 = "contribute more as last stop").


So, How to decide when we need Resources Reallocation?

Before drilling into details on how we could leverage such report for resources planning, let's talk more about how to determine a if a channel is "Good-or-Bad" under the new complexity of conversion cycle.

Knowing the Path is one thing, determine the effectiveness is another

To answer such question, indeed, it depends on the "what you are looking for". In general, a channel with high ROI (relative to other channels) would always mean that they're performing better. With the help of Google for having segmentation in Assisted between Last Interaction makes this question more insightful: is certain channel better at assisting other channels for conversion? If i were Levis, should my f-commerce strategy more effective in assisting other channels or driving direct conversion?

Another frequently asked questions would be, instead of Channel level, how good would certain Ad Group performing? How good are we adapting our Sales cycle along with our SEM strategy (i.e. paid search traffics driven by targeting relevant landing pages based on Awareness-Consideration-PurchaseIntent model) ? An effective Ad Group should thus have a relatively higher Assisted ROI if it is targeting for Awareness or Consideration items, otherwise we should change the target to Purchase Intent or even Conversion pages if it's last interaction ROI is higher.

Simply speaking, to determine if we reallocating from one to another, we need to determine the characteristics of the items, either they're Channels or AdGroups, first.



Assisted ROI & Direct ROI Estimation

Normally Google suggests us to us "Assisted / Last Interaction Conversions" to analyze for how good certain channel perform in either Assisted or Direct way. But it's just a ratio based on "occurrence". If you have followed the whole logic so far, you should know by now we should look for a way to determine both the Assisted ROI (from Assisted Conversions) or Direct ROI (from Last Interaction Conversions) of Channels which provide a more business angle for us to handle our question. So how could we calculate such business metric based on what we currently have (the Assisted Conversion report)? Let's begin from the basic definition:


As for our case, we could easily fill-in-blank using the following formulas...




And here's how the data (fake one) presented in a spreadsheet:

Spreadsheet with mock-up data (already explained a lot of things!)
Organ Part - Assisted Conversions Report from Google Analytics 
Green Part - Cost spent a particular Channel (or items). Based on the participation concept, the total Cost spent on a Channel will be shared by all the Assisted and Direct Conversions, thus the Assisted Cost and Direct Cost of a Channel could be estimated by the portion of corresponding conversions achieved. (If you wish to know more about Costing Estimation, we have a detail post here.)
Purple Part - ROI based on corresponding segment (Assisted or Direct)


Easy enough, to determine the channel characteristics, we simply put the data on a Relational Map, with x-axis as Assisted ROI and y-axis as Direct ROI. Almost done!

Looks like the Referral is under-preformed, sounds like a good action point to begin with!


What Actions We need to Take?

I couldn't emphasize more enough that any chart or infographics without Action Triggers is simply meaningless. In my last post, where I have talked about how we could put an infographic onto an upper level and make it more actionable in the 5th steps. A relation map like above is no more than a graphics presentation based on data. So the key is to help readers identify the action right away after they read the chart. On the above chart, think about breaking down into 4 different sections:
1 | 2
3 | 4
Section #1 - Channels that are bad in Assisted Conversion (-ve Assisted ROI) but good at Direct Conversion (+ Direct ROI)  
Section #2 - Channels that are good at both Assisted and Direct Conversion 
Section #3 - Channels that are bad at both Assisted and Direct Conversion.... (simply under-preformed...) 
Section #4 - Channels that are good at Assisted Conversion but bad at Direct one 

Now identifying action is simple:

If you are looking for under-performed channel, read Section #3, those channels are definitely having some issue (which you have to investigate!)

If you are looking for performance of social entities, like Facebook, Twitter, Youtube, and even other online communities,  where you are expecting high Assisted ROI, see if they're at Section #2 or #4, if not, well, you know what i mean.

How about reallocation of resources? Start from something poorly performed and move those resources, usually dollar-signed, to those well performed ones. Simply speaking, if you have decide to reallocate instead of optimizing or fixing problem, move resources from items in Section #3 to those in #2. Easy.

The point here is, in any business, or even down to a single business process (like SEM), all we're focusing is Return on Investment. If some operation couldn't bring return in any form (e.g. Impression is a kind of return, and we could easy convert it into dollar-signed using CPM), then it is either we need to fix the problem, or simply give it up and free the resources for those well-performed ones.

Always remember the if-this-than-that rules. It always helps in designing for actions triggers.


Looks Good, but only Channel level Analysis?

No. (Why stop here? XD)

The Assisted vs Direct ROI drives lots of potential dimensions in analysis, here's some other variation we could take a look based on the same logic as above:

1. Referral Analysis
Segment the Assisted report based on Source/Medium will give you a over view in all upstream traffics. It is essentially important if you have broad social media strategy which occupying different channels like facebook plus twitter plus linkedin plus pinterest and so on... then such break down will let you understand how good is your social media team is working and let them know if they need to tune their tactics in different media.

2. Campaign Analysis
A more aggressive approach is broken down by Campaigns. This angle provides marketers a more insightful view on how different campaigns are performing. Not limited to social media engagement, but also social ad. vs sponsored tweets, break-up email vs cart-abandon emails, banners ad vs display ad, (offline with qr code) etc. Make sure your marketing team have tagged the upstream URL correctly in order to fully leverage this powerful report.

3. AdGroup / Keywords Analysis (in AdWords)
The last angle we could have a look is the SEM performance, which, traditionally, we focus too much solely on the click-through rate and cost per click, and simply overlook the importance of how they actually generate goals or even leads to our business. With the Assisted / Direct ROI model we could now easily tell if certain AdGroup or Keyword are performing as expected, says, a set of retention keywords (e.g. "where to repair my iPad 2?") should be expecting a higher Assisted ROI as it helps satisfying customer and supporting future purchases. This will also help strategizing how each landing page should be doing as well.

---------------------(i'm just a <hr/> tag......)--------------------------

I guess that's for the looooong class.  (my bad style..... XD)

How much are you convinced by the model? Have you tried feeding in your real business data and see how they work out? Drop me a line if you have any comments or questions ! Would love to hear from you !

Again, subscribe me if you haven't,  if you like, and feel free to connect with me, too !

Coming soon will be the "Framework for Business Infographics Design - v1.0", so Stay Tuned !!!~~

Cheers,
Dickson


Other Stories you may be interested:

 4 Approaches to Estimate Cost for Multi-Channel in Google Analytics
Two Possible Hacks to Reduce Omniture Test & Target Cost 
6 Steps to Crack a Complex Business Report into Actionable Infographics 
[How to] Crack a Complex Business Report into Actionable Infographics (Part 1) [Long Story Alert !] 
4 Things Startups Should Learn from Moneyball



8 comments:

  1. Hi Dickson,

    Great post, i am fond of excel reports when it comes for web analytics.

    I just have one confusion in your above report.

    How you calculated TOTAL CHANNEL COST.

    Regards
    Shailendra Dubey

    ReplyDelete
    Replies
    1. Hi Shailendra,

      I have written a quick posts to clarify the costing estimation for, please kindly find the following link for detail! Thanks!!~

      http://idea-stack.blogspot.com/2012/02/4-approaches-to-estimate-cost-for-multi.html

      Delete
  2. Thank you for your post Dickson,

    I'll get the same percentages for assisted and direct ROI.

    Have you given different value per conversion for assisted and direct?

    ReplyDelete
    Replies
    1. Thanks for pointing this out Gerard!

      First of all, whether it's an assisted or direct conversion, GA do the counting based on Goal Value only. The only different between Assisted and Direct Conversion Value is just "a position on the path". Simply speaking, if a channel experienced a conversion through two different path, which one is achieved as Assisted and the other is Direct one, then both value will be the equal.

      Now back to the question why it's the same. I have played with the Maths around and believe that under the following condition, your situation will occur:

      1. if the entire has only ONE goal
      In this case no matter how the channel contribute to both type of conversion, the conversion value will be the same as both are referencing the same conversion

      2. if all the goals under the site have the same Goal Value
      In this case, again, conversion value will always be the same for both Assisted and Direct one.

      Currently i could only think of these two reasons.... do feel free to let me know if you have fitted any of those cases. I will investigate more when i would be less busy.... :(

      In any case, i believe the model works normally when a site is configure correctly with multiple goals and each with different goal value.

      Please drop me the comment and let me know if this could solve your problem.


      P.S. And thanks for the response, you inspire me on a new topic... XD
      i guess i will write a post on practical Goal Value estimation soon. Stay tuned. :)

      Delete
  3. Thanks for your response Dickson. I have attributed a different value to assisted and direct conversion. But I'll get extremely high ROI values.

    It is one goal with a value of 36 euro. I give assisted conversion 0,5 value and direct conversion: 1,0 value.

    How did your calculation in the ROI example above?

    ReplyDelete
    Replies
    1. Let's try this way:

      1. One Goal = 36 Euro
      2. Assuming you have got 100 Assisted Conversion & 200 Direct Conversion
      3. and you spent 300 Euro in this channel

      then
      Assisted Conversion Value = 100 * 36 = 3,600
      Direct Conversion Value = 200 * 36 = 7,200

      Estimated Cost on Assisted Conversion = 300 * (100/(100+200)) = 100
      Estimated Cost on Direct Conversion = 300 * (200/(100+200)) = 200

      So Assisted ROI = 3600/100 = 36 (or 3600%)
      and Direct ROI = 7200/200 = 36 (or 3600% again)

      That's why you will get same ROI, because the above model assumed the Channel Cost is evenly contributed towards each conversion. And personally i would not massage the data in #1 & #2, because they're raw data exported from GA.

      On the other hand, high ROI would possibly because of:
      1. Very low Channel Cost
      2. Very High Goal Value

      a result of very High ROI could either telling you your channel is really very effective, or there might be a problem in those assumption (does the channel spent so few? or does the goal value worth that much? etc)

      For Cost Estimation, i have written another post "4 Approaches to Estimate Cost for Multi-Channel in Google Analytics" to assist other for cost estimation, you could take a look and see if it could help you! :)

      Cheers.

      Delete
  4. Thank you Dickson for your explanation. I am gonna test this. Finally a model to reallocate your budget per online marketing channel!

    ReplyDelete
  5. ​We at Cooper Webdesign (https://www.cooper.dk) are using Google Analytics Funnels a lot. We have set up the goals both from events and also by using paths and virtual paths.

    My question is, if you know how it would be possible to track and analyse the individual form-items on the individual step in the funnel?

    ReplyDelete