When communicators see the term ROI, it’s like waving a red flag in front of a bull. Irresistible—but it only leads to trouble. I get a Google alert every time someone mentions “social media ROI” or “PR ROI.” In my role as Chief Herder-of-Cats to The Conclave on Social Media Measurement Standards, I feel a duty to search out any and all flagrant misuse of standard measurement terminology and best practices. These Conclave-approved terms and techniques have been crafted and agreed upon by more than three dozen brand marketers, PR agencies, and academics. And more than 100 organizations have already pledged to support these standards.
I find those Google alerts to be better than a triple shot at Starbucks at getting my brain waves going.
Here are a few typical examples—and why you shouldn’t believe a word they say. My comments are in purple, the actual text is in italics, and the most egregious errors are in red.
1. This one’s from a prominent speaker at a major international conference that somehow has confused activity with profitability, and click rates with awareness:
How Can I Prove a Return on Investment for Social Media?
Discover 7 Key Metrics for Profitability That You Can Email Every Day to Your Boss
(Nobody—that’s nobody—actually measures the ROI of social media. And if they claim to do so, they are one of our Measurement Menaces of the Month.)
Measure awareness – Facebook Insights and Twitter Analytics allow you to track the success rate of your posts, advertisements, and interactions. These are the perfect places to start charting the effectiveness of your social media efforts.
(The way to measure awareness and visibility is through a survey. Never mind that only a small percentage of people actually see anything on Facebook or Twitter! Facebook estimates less than 3% of anything posted on FB is actually seen, so how does that translate into “awareness?” And even if they click on something that doesn’t mean they’ll remember it an hour later.)
Show engagement – Measure trends, topics, hashtags, and more with Brandwatch, GroSocial, and Keyhole. This allows you to see how your efforts are affecting your brand’s visibility from your specific profile.
(The degree to which social media hashtags and mentions impact brand visibility is seriously debatable. First of all, not all social engagement is desirable. Secondly, whether social media impacts your brand depends on your target audience and brand. So you can’t make broad generalizations about brand visibility just from measuring trends on Twitter.)
Chart influence – You can use tools like HootSuite and SocialFlow to track sentiment toward your brand across the internet. This allows you to see if your social media efforts are painting your organization in a positive or negative light.
(Sure you can track sentiment in social, but it may or may not be accurate enough to actually tell you how people are feeling about your brand. Many sentiment engines are only good for easily identifiable products, like specific movie titles or unique spellings. If you don’t review the sentiment carefully, you’ll likely make some rash generalizations based on flawed data.)
2. And this from a major presenter at the AMEC Measurement Summit (where the original Barcelona Principles were introduced).
ASRs provide the cost of purchasing the equivalent amount of media space and/or time as advertising and are a quantitative statistic used to evaluate publicity. The iSentia ASR methodology is based on:
Print: casual column centimetre advertising rates for newspapers, casual full-page colour rates for magazines; content size
Radio and Television: content duration; 30 second cost per thousand (CPT) advertising rates; timeslot average audiences; prime time 30 second rate cards (where CPT/audiences are unavailable)
Online News: Cost per thousand (CPM) or time-based advertising rates; daily page impressions; daily unique visitors; daily content produced; content size
(AVEs, god help us, AVEs!)
3. Then there was this, from another major supporter of the Barcelona Principles:
NEW YORK, Feb. 13, 2012 /PRNewswire/ — Kantar Video, a division of WPP’s insight, information, and consultancy network, Kantar, has released the results today of a comprehensive study of online video viewership and social activity from Super Bowl XLVI advertisements. The study finds that within the first 3 days, the top 10 ads created $862,000 on average in earned video impressions, a 12.7% return on the cost of a Super Bowl ad spot. Overall, this year’s ads have created over $11 million in earned media and saw a 267% increase in viewership over last year’s Super Bowl. This increase in online video viewership underlines the increasing trend for advertisers to use the Super Bowl as a launch-pad for multi-platform commercial campaigns.
(AVES, again with the AVES.)
4. And finally this from Sports Video Group talking about how social media has become a major priority:
However, as sports organizations tout the importance of social media to branding and fan engagement, a question arises: when will it deliver a return on their investment?
“We do look for social media to bring in revenue, but we use social as a branding tool first and a business tool to bring in revenue second,” said New York Mets Director of Social Media Will Carafello at the 2nd Screen Summit: Sports event last month. “Keeping fans engaged is as good as ROI for us.”
(That is the equivalent of saying that reading a recipe is as good as eating a gourmet meal. There is no way your Chief Financial Officer or investors would agree that fan engagement is as good as ROI. They are two different things. One is a potential indicator of fan loyalty which may at some point turn into revenue, the other is an actual increase in revenue.) ∞
Thanks to Jacob Gaudet for the image.

