Recent Articles

The December Issue of the Journal of Advertising Research (JAR) has Great Metrics Articles!

There are a couple of useful articles this month in the Journal of Advertising Research. They are on a roll over at the JAR, driving some great discussion in the last few months about measurement of marketing, digital and otherwise. Recommended reading in this month’s issue:

Commentary: Who Owns Metrics? Building a Bill of Rights for Online Advertisers”, by Benjamin Edelman, Harvard Business School Assistant Professor in Negotiation, Organizations & Markets
Ben Edelman, who has written on the role of deception and overcharging in online media (among other topics) is right on target here – he argues that advertisers have a right to know where and when their ads are being shown, delivered in the form of meaningful, itemized billing. He also asserts the advertisers’ ownership of the data that comes from their campaigns, and says they should (for example) be able to use data collected from their Google PPC campaigns to target campaigns on MS AdCenter or Yahoo! This is definitely a controversial area – certainly Google, along with cable and satellite TV operators, would disagree – read it and let me know what you think.

It’s Personal: Extracting Lifestyle Indicators in Digital Television Advertising, by George Lekakos, Assistant Professor in e-Business at the University of the Aegean, Greece.
In case you think my comment about TV distributors wanting to own audience data is irrelevant in the context of digital marketing, Lekakos lays out a scheme for using set-top box data to discover and target lifestyle segments that are then used as part of a targeting algorithm. The author lays out an approach by which TV set-top box data can be used to drive very accurate personalization and targeting of ads, but the question of whether the data belongs to the distributors, the programmers, or the advertisers is quite critical to whether this can be implemented. I’d have to say that the question is far from settled.

Measuring Advertising Quality on Television: Deriving Meaningful Metrics from Audience Retention Data<by Dan Zigmond, Sundar Dorai-Raj, Yannet Interian, and Igor Naverniouk
The authors explore the use of audience retention metrics captured via TV set-top boxes as a measure of ad quality. They use a “retention score” that purports to isolate the effect of ad creative on audience retention, and link it with future audience response and qualitative measures of ad quality. They assert its usefulness as a relevance measure that could be used to optimize TV ad targeting and placement. Again, we should note that the issue of data ownership needs to be dealt with if this approach is going to be applied widely.

The Foundations of Quality (FoQ) Initiative: A Five-Part Immersion into the Quality of Online Research, by Robert Walker, Raymond Petit, and Joel Rubinson
To address both the increasing importance of online research and questions about its validity, the FoQ Initiative has been undertaken to measure the quality of online research. The Online Research Quality Council included large advertisers, ad agencies, academic researchers, and research suppliers in the process. Among the issues they addressed: accuracy, representativeness, and replicability of results, identification and handling of questionable survey-taking behaviors, and the suspicion that small number of “heavy” online respondents are taking most online surveys.

Some of the interesting findings:

  • There is significant overlap in membership of various online research panels, but no evidence this causes data quality issues
  • Multiple panel membership actually lowers the odds of “bad” survey-taking behavior by 32%
  • You should keep surveys short – longer surveys increase the occurrence of “bad” survey-taking behavior by 6X
  • Age matters – younger respondents had 2X the occurrence of “bad” survey-taking behavior than older ones
  • Facebook Dominates Social Media Searches (Yet More Fun With Google Trends)

    Playing with tools is fun – I did another Google Trends search, this time comparing “Facebook” to “MySpace”, “YouTube” and “LinkedIn” as reference points. Wow – searches for “Facebook” have really grown amazingly fast (see the first chart, below). I wish I had bought a piece of that company 2-3 years ago.

    It occurred to me that there should be a corresponding trend in searches for “social networking”, relative to other online marketing activities (e.g., email, search, display advertising). Searches for “social networking” have had a huge growth rate, but the absolute volume turns out to be really small compared to “email” and “search”. I guess there is still time to get on that bandwagon. The search volume for “Facebook” crushes that for those terms, but this is made harder to interpret by the fact that these are much more likely to be searches by users, not just marketing professionals.

    Search Volume for Analytics Ramping Up Steadily – (More Fun With Google Trends)

    Just for fun, I did another Google Trends search, this time on “analytics” – adding “CRM” and “ERP” as reference points. The result seems to suggest that if you are in the business software market, that you should have an analytics offering. We’ll see, but I predict that the hot growth area in business software in 2010 will be Analytics. Searches for analytics have been steadily ramping up for the last several years, and are now at a higher level than searches for the above-mentioned enterprise business software categories.

    I find it very interesting that searches for “ERP” and “CRM” have been flat for so long, but REALLY interesting that the volume of “analytics” searches surpassed them in 2009.

    Strong Seasonal Pattern Found in Search Data for Marketing Mix

    I guess it makes a kind of sense, but a search I did in Google Trends on the phrase “Marketing Mix” indicates that marketers are only interested in the topic during the colder months of the year. I guess once plans are submitted and budgets are approved, they have bigger fish to fry. Or maybe they are in the Hamptons. Take a look at the graph in the screenshot below – classic annual seasonality, right?

    One of the changes I would expect to happen in the next few years, is that focus on marketing mix will become more continuous, and this graph will look more linear.

    New Partnership Measuring Online Ad Impact on CPG Sales: IRI, Comscore, AOL, [x+1], and Dynamic Logic

    A recent spate of press releases (HERE, HERE, and HERE, among others.) announced a partnership that will offer measurement of online advertising’s sales impact for consumer packaged goods companies. What does this mean to online content providers, agencies and ad networks? If there is a credible way of measuring the impact of online advertising on the sales of snacks, beverages, health and beauty aids, OTC pharmaceuticals and household products, this will unlock huge CPG money that has been held back from full adoption of online advertising because of uncertainty about its relative effectiveness compared to channels CPG companies have used for decades. Did I say “huge money”? I meant to say HUGE MONEY.

    This will ultimately have a secondary effect that is good for the analytics business – it will raise the bar. CPG companies have long used analytics to plan and measure impact for their media spending, and as a result, they are data and modeling savvy. They will not blindly accept whatever someone pulls from Atlas, DoubleClick, Google Analytics, Omniture or WebTrends. The CPG paradigm is one where the cross-effects and tradeoffs between different media channels are measured and modeled, and nothing gets the big spend unless the numbers support it. This goes way beyond just throwing some tags in some ads and counting impressions, clicks and conversions. This entails starting with capture of how marketing dollars are spent, and then modeling how the spending does or does not move total sales (not just the sales from online). Things are about to get even more interesting.

    Interactive TV Today Cites Practical Marketing Analytics RE: the Future of iTV

    ITVTLogo
    I got some coverage in iTVT! (See the link HERE.) Rick Howe, who writes a regular column for iTVT called “The iTV Doctor is In!” ran a response from me today in his year-end wrapup. He is doing a series of columns featuring iTV industry pundits’ answers to this question:

    “Dateline: December 22, 2012 – Well, we got past the Mayan “end of the world” prophecy and the world didn’t end. In point of fact, our little corner of the world–interactive television–is doing quite nicely, thank you. We have dozens of enhanced/interactive television programs airing every night in over 60 million homes; advertisers have stepped up, and are now paying a healthy premium for interactive spots; and viewers now EXPECT interactivity in their favorite shows–it’s just part of the experience.

    What was the single most significant factor that led to this success?”

    Anyway, it was a cool assignment, and I won’t spoil the fun by telling you my full answer here, but standards and user-oriented design are where I placed the future credit the amazing success that I hope happens. To get my full response, along with those from Arthur Orduna (CANOE’s CTO) and Ellen Dudar (FourthWall Media’s Chief Product Officer), go read the ARTICLE.

    CIMM Meeting With TV Measurement Companies set-

    According to an article today in MEDIAWEEK (see article here), the Coalition for Innovative Media Measurement is meeting with Nielsen, Rentrak, TiVo, TRA and TNS Media Research to get feedback about their set-top box research RFP (see my last post). I would love to be in on those meetings – it would be like getting a glimpse of the next 5-10 years of media measurement. In any case, they would not be boring – especially the one with Nielsen, whose current ratings are the thing that CIMM is looking to replace with something better.

    The article states, interestingly that CIMM: “… can depart from the typical RFP process of awarding a single contract and instead foster a collaborative relationship among the research and data providers to identify multiple projects that would meet the RFP”. Perhaps they, too, wonder who would respond.

    Coalition for Innovative Media Measurement – the CIMM – Gets Launched

    The Coalition for Innovative Media Measurement (the CIMM) launched their website last week (http://www.cimm-us.org). Members in the coalition consists of TV programmers, advertisers, and ad agencies. While AT&T is represented, it is their Brand Marketing and Advertising SVP who is sitting on the council.

    The CIMM released two research RFPs on their site last week. The two areas for investigation:
    1. Investigate the current and future potential of TV measurement via set top box data
    2. Cross-platform measurement of video across Television, Internet, and Mobile

    This may sound simple, but don’t let the short sentences fool you. The first one alone is loaded with gotchas that will make responders think twice. First of all, they have to be the first of the set-top box vendors willing to be completely transparent with their data and their processes. This is unlikely to be undertaken by an operator for the usual price of a research study.

    Who knows? Maybe I am wrong and one of them will step up in order to get first-mover advantage in the data-vending business. Maybe AT&T will get pulled in because of their participation in the council. The reason I am skeptical is that the operators are unlikely to arm programmers with better information to use against them in negotiations around carriage fees etc. without getting a really huge concession or advantage in return. Perhaps it might make more sense for a company like TiVo to participate than it would for a cable, telco or DBS operator.

    As someone who wants access to the information, I hope I am wrong and would love to be proven so. We’ll see.

    Forrester Publishes Evaluation of Interactive Attribution Vendors: ClearSaleing, Visual IQ, And Atlas Lead, With [x+1] And Coremetrics Close Behind

    I was just looking at the summary of the new Forrester report comparing interactive attribution vendors. My old friends at [x+1] are in the mix, even stacked up against players like Atlas, ClearSaleing, Visual IQ and CoreMetrics – despite the fact that attribution is not mainly what they do. They do it because it needs to be done well in order for them to deliver on their core competency, which is using industry-leading optimization of performance for online media and websites. Attribution is critical to optimizing media and site performance because you need an objective function (a numeric “score”) to optimize or even improve: attribution is how you keep score. Attribution is the process whereby credit for a conversion (a goal action, like a sale, subscription, or lead) is allocated among the many marketing activities and actors selling that product or service.

    Historically, 100% of the credit for a sale has been attributed to the last online marketing “touch” before a purchase was made, in more or less this way:
    1. All touches (impressions, clicks, conversions) needed to be tracked in the same system to be “attributable”
    2. When a goal action occurred, the database was searched for the most recent impression with a click. If one is found, then it got attributed “credit” for the goal action. This is what is sometimes referred to as a “clickthrough conversion”.
    3. If the whole attribution window (the time frame for which impressions are considered eligible for attribution) is searched and no click is found, then the most recent impression is found, and assigned (usually partial) credit for the conversion. This is sometimes referred to as a “view-through conversion”.

    The new paradigm in attribution, represented by the offerings of the firms reviewed in the referenced Forrester paper, involves the effort to model, understand, and optimize the sequences of marketing activities that touch a prospective customer. Each of these “touches” is seen to have potential influence on the ultimate outcome (conversion vs. non-conversion), and the solutions here are ways of assigning a value to the contribution of each interaction. Some approaches to doing this are built upon models of the buying process, others are more brute force. Some vendors offer this as an approach for marketing mix allocation, others are more focused on banner, search, and site optimization.

    If all this sounds fun and interesting to you, then you must be in analytics. Otherwise, the takeaway for you will just be this: better ROI (and better ROI measurement) from online marketing activities.

    Practical Marketing Analytics’ Bill Seely interviewed in InteractiveTV Today

    Bill is interviewed in Rick Howe’s “Dear iTV Doctor” column published today (Friday October 16, 2009). Check it out at http://bit.ly/mLaD7.
    The topic was how to apply interactive television to engage and activate a TV show’s superfans. Bill talks about the impact of tailoring the design and features of an interactive experience embedded in a TV program to the needs and interests of the hard-core fans of the program.

    Rick’s column appears regularly in Tracey Swedlow’s InteractiveTV Today (ITVT) (www.itvt.com), the most widely read and trusted news source on the rapidly emerging medium of multiplatform, broadband interactive television (ITV).

    Get Adobe Flash playerPlugin by wpburn.com wordpress themes