by
Selena Blue, Manager of Editorial Content
CHALLENGE
Audiences don't come in a one-size-fits-all package. That presents a challenge, and an opportunity, for marketers. Jon Powell, Senior Manager of Research and Strategy, MECLABS, has discovered that fact to be especially true when it's other marketers who make up the audience.
MECLABS is a science lab that uses real-world research to discover what works in marketing.
Powell has presented training on different marketing optimization topics to numerous audiences, but a recent training session with a national association opened his eyes to a potential new segment of marketers. What type of content would connect to them?
Overall, Powell said, "We wanted to know how to have a better conversation with the classic marketer."
CAMPAIGN
Search engine marketing is a great channel for acquiring new customers. It's also an ideal channel for experimentation, as tests require little in terms of resources or time.
Powell and his team embarked on a three-part testing series using PPC advertising to discover how to speak to potential audiences in a way that gains their interest. The third phase took place at
Web Optimization Summit 2014 in New York City.
At the heart of each phase of testing, the company's value proposition helped guide the messaging of the ads. The team hoped each phase would narrow down the ideal message further and further.
Phase #1. Determine the most effective PPC keyword group
First, the team needed to determine the most effective keywords to target. This required a few key steps. The team had particular interest in discovering the effectiveness of research-based messaging, as one of its brands, MarketingExperiments, puts much emphasis on research on
its homepage.
Step #1. Perform keyword research
While keyword research seems simple enough, it's an important step you shouldn't overlook. Powell said, "Keywords give us clues as to what customers are interested in."
In pursuit of having a "better conversation with a classic marketer," the first step is to have a conversation they want to have. That's where the research comes in.
Powell researched types of search terminology used by marketers and discovered two keyword groups:
marketing strategy and marketing research.
The MECLABS team discovered a few baseline metrics in their research of those groupings:
- Average clicks per day
- Average impressions per day
- Cost
- Clickthrough rate
- Average cost per click (CPC)
These metrics would help them determine which keywords they could get the biggest bang for their buck. For example, "marketing strategy" had the least impressions, but it also had the highest clickthrough rate and the lowest CPC.
Step #2. Evaluate value proposition
Before testing the selected groups, the team looked at the MECLABS value proposition to see how they could incorporate it into the PPC ads.
Powell broke down the MarketingSherpa value proposition into a list of potential claims of value, including:
- 1,480 case studies
- 1,060 how-to articles
Those claims were then assigned to one of the two keyword groups based on which the claims supported best.
Step #3. Craft PPC ads
Using the claims determined in Step 2, Powell crafted two PPC ads, one for each keyword group:
Free Marketing Research www.MarketingSherpa.com/Research Interview with VPs and Directors 1,480 free case studies. Search Now | | | | | | | | Free Marketing Research www.MarketingSherpa.com/Research Interview with VPs and Directors 1,480 free case studies. Search Now
|
|
He tried to keep the messaging structure of the ad the same to better isolate the difference in the content.
Step #4. Test keyword groups
Lastly, the team tested the two ads in a popular search engine. To ensure they would reach validity within the parameters they set, they used the
MECLABS Validation Tool to project the minimum sample size and test duration needed.
"The test validated in just three or four hours," Powell said.
Which PPC ad performed best? The research-focused ad decreased clickthrough by 62% compared to the strategy-focused ad. The test results indicated that marketers were more interested in strategy-based content.
Powell had this hypothesis about the results: "Research requires work. The classic marketer is overwhelmed enough as it is and would rather get something they can use immediately."
Phase #2. Uncover the most effective value claim
After determining the most effective keyword group — marketing strategy — the team wanted to know which value claim best attracted potential visitors. For this phase, the team decided to focus its efforts on the MarketingExperiments brand instead of MarketingSherpa. This second phase mirrored some of the previous phase’s steps.
Step #1. Identify value claims to test
As part of value proposition development, MECLABS has identified
eight potential claims of value for its MarketingExperiments brand. That significant difference allowed the team to feel comfortable focusing their upcoming efforts on that segment.
Powell ranked those potential claims of value and selected three he thought would have the most appeal and exclusivity in the PPC channel:
- The largest public library
- The first public library
- The latest public library
Step #2. Craft PPC ads
Using those three value claims, Powell and his team crafted three PPC ads:
Find a Marketing Strategy www.marketingexperiments.com The largest public library of tested marketing strategy on Earth
| | | | Best Marketing Strategies www.marketingexperiments.com The 1st ever public library of tested marketing strategy online
| | | | Largest Marketing Strategies www.marketingexperiments.com The most-to-date public library of tested marketing strategy online
|
|
Again, to isolate the test variable, each PPC ad used similar wording and structure.
Step #3. Test value claims
Powell and his team then set up the three ads to compete against one another in a split test.
Which value claim best matched the motivation of visitors searching for information about marketing strategies?
The "Best Marketing Strategies" PPC ad won by increasing clickthrough by 37%.
Powell said he believed the test resulted this way because "customers care more about authority than usefulness when searching for this type of help."
Phase #3. Discover the most effective usage of facts that support value claims
For the MECLABS team, Phase 3 incorporated some outside help. As part of a live test performed at Web Optimization Summit 2014, the audience was asked to help develop the test.
On day 1 of Summit, Powell provided the audience with background information to set the stage. The winner of Phase 2 would be the control for Phase 3 of testing.
Step #1. Craft PPC ads using evidentials
While using value claims can create broad messaging, using evidentials, or supporting facts, can provide a value claim more authority.
When asking the audience to craft their own treatment PPC ad, Powell provided them with the below list of facts about the company that could support the value claims:
- Established in 1997
- First report published in 2001
- Offer Response Theory Validated in 2003
- 10 heuristics (strategic guides) patented in 2006
- 1,500 statistically significant experiments to-date
- $20MM of published research to-date
- Cited in 13,000 sources
- 10,000 pages tested to date
The audience had free reign how they used those evidentials. They could use none, or they could incorporate multiple proof points into their ads.
Powell also provided them with a tool to craft those ads, the
MECLABS Ad Optimization PPC Tool. It allowed the audience to quickly craft ads that adhered to formatting and character limits set in place by the search engines.
With all the tools and information they needed, the Summit audience gathered in groups and crafted treatments to submit to Powell and the team.
Step #2. Select PPC ad treatments
In total, the team received 50 ads from the audience. The team then narrowed that down to five treatments.
Powell described the reasoning behind the selection process: "The goal is not just to get a lift, but to get a learning. So we wanted it to be somewhat progressive or to be connected in a way that would give us a learning."
The audience was then asked to vote for one treatment, and the top two treatments would be tested against the control.
The Phase 3 test included the following three PPC ads:
Control Best Marketing Strategies www.marketingexperiments.com The 1st ever public library of tested marketing strategy online
| | | | Audience Choice 1 Best Marketing Strategies www.marketingexperiments.com Get 17 years of marketing research & 10,000 case studies for free
| | | | Audience Choice 2 Best Marketing Strategies www.marketingexperiments.com 10+ patented strategic guides 1500+ proven tests. Free Access
|
|
Step #3. Test PPC ads
After settling on three ads, the team launched them by mid-afternoon on day 1 of Summit. A winner validated by the evening.
Audience Choice 2 had an 88% relative increase, with a 99% level of confidence. To know if the results were significant, Powell used the
MECLABS Testing Tool.RESULTS
We've covered the numerical results in each phase, but this series of tests was about more than relative lifts. The goal was to learn about MECLABS' customers. Powell reviewed this with the Summit audience.
"In both cases, the audience ads have a level of specificity the original ad doesn't. You can even argue that 'free' played a part," Powell said.
He then asked the audience, "Why did Choice 2 outperform Choice 1?"
"One underlying common denominator for each of these ads is authority. It seems as the perceived authority increased in the minds of customers, so did the results," Powell explained.
For the average marketers looking for strategy help, the evidentials provided in Choice 2 could appear to hold more clout or authority.
So do patented guides carry more authority than years of research? Do proven tests mean more in the mind of customers than case studies?
These are questions worth further testing. But it certainly shows an interesting discovery about the MECLABS audience. That's what the live test was about: demonstrating how valuable customer insights can be discovered in as little as two days.
Creative Samples
- MarketingExperiments homepage
- Keyword research
- Validation Tool
- Claims of value for MECLABS
- Ad Optimization PPC Tool
- Audience ad submissions
- Testing Tool
Campaign Team
MECLABSSteve Beger, Senior Development Manager
William Duke, Marketing Manager
Taylor Lightfoot, Data Scientist
Jon Powell, Senior Manager of Research and Strategy
Alissa Shaw, Research Analyst
Brian Street, Research Manager
Aimee Thompson, Events Manager
Related Resources
Download the
MECLABS Ad Optimization PPC ToolDownload the
MECLABS Testing ToolValue Proposition: Which of your value claims is most appealing to new customers?Value Proposition: 3 steps for laying your value prop testing groundworkWeb Optimization Summit 2014 Wrap-up: Top 5 takeaways to improve your testing and optimization