June 04, 2014
Case Study

PPC Marketing: Testing value proposition messaging increases clickthrough 88%

SUMMARY: Many website audiences are made up of more than one customer segment. The question is if you are best communicating with multiple segments.

MECLABS, the parent company of MarketingSherpa and MarketingExperiments, provides marketers of all types with information on what works in marketing. The team wanted to know if they were communicating the value proposition of MECLABS' brands in the most effective manner for their audiences. This case study reveals how the team used PPC ad testing to increase clickthrough to the company's websites by 88%.
by Selena Blue, Manager of Editorial Content

CHALLENGE

Audiences don't come in a one-size-fits-all package. That presents a challenge, and an opportunity, for marketers. Jon Powell, Senior Manager of Research and Strategy, MECLABS, has discovered that fact to be especially true when it's other marketers who make up the audience.

MECLABS is a science lab that uses real-world research to discover what works in marketing.

Powell has presented training on different marketing optimization topics to numerous audiences, but a recent training session with a national association opened his eyes to a potential new segment of marketers. What type of content would connect to them?

Overall, Powell said, "We wanted to know how to have a better conversation with the classic marketer."

CAMPAIGN

Search engine marketing is a great channel for acquiring new customers. It's also an ideal channel for experimentation, as tests require little in terms of resources or time.

Powell and his team embarked on a three-part testing series using PPC advertising to discover how to speak to potential audiences in a way that gains their interest. The third phase took place at Web Optimization Summit 2014 in New York City.

At the heart of each phase of testing, the company's value proposition helped guide the messaging of the ads. The team hoped each phase would narrow down the ideal message further and further.

Phase #1. Determine the most effective PPC keyword group

First, the team needed to determine the most effective keywords to target. This required a few key steps. The team had particular interest in discovering the effectiveness of research-based messaging, as one of its brands, MarketingExperiments, puts much emphasis on research on its homepage.

Step #1. Perform keyword research

While keyword research seems simple enough, it's an important step you shouldn't overlook. Powell said, "Keywords give us clues as to what customers are interested in."

In pursuit of having a "better conversation with a classic marketer," the first step is to have a conversation they want to have. That's where the research comes in.

Powell researched types of search terminology used by marketers and discovered two keyword groups: marketing strategy and marketing research.
The MECLABS team discovered a few baseline metrics in their research of those groupings:
  • Average clicks per day

  • Average impressions per day

  • Cost

  • Clickthrough rate

  • Average cost per click (CPC)

These metrics would help them determine which keywords they could get the biggest bang for their buck. For example, "marketing strategy" had the least impressions, but it also had the highest clickthrough rate and the lowest CPC.

Step #2. Evaluate value proposition

Before testing the selected groups, the team looked at the MECLABS value proposition to see how they could incorporate it into the PPC ads.

Powell broke down the MarketingSherpa value proposition into a list of potential claims of value, including:
  • 1,480 case studies

  • 1,060 how-to articles

Those claims were then assigned to one of the two keyword groups based on which the claims supported best.

Step #3. Craft PPC ads

Using the claims determined in Step 2, Powell crafted two PPC ads, one for each keyword group:

Free Marketing Research
www.MarketingSherpa.com/Research
Interview with VPs and Directors
1,480 free case studies. Search Now
Free Marketing Research
www.MarketingSherpa.com/Research
Interview with VPs and Directors
1,480 free case studies. Search Now


He tried to keep the messaging structure of the ad the same to better isolate the difference in the content.

Step #4. Test keyword groups

Lastly, the team tested the two ads in a popular search engine. To ensure they would reach validity within the parameters they set, they used the MECLABS Validation Tool to project the minimum sample size and test duration needed.

"The test validated in just three or four hours," Powell said.

Which PPC ad performed best? The research-focused ad decreased clickthrough by 62% compared to the strategy-focused ad. The test results indicated that marketers were more interested in strategy-based content.

Powell had this hypothesis about the results: "Research requires work. The classic marketer is overwhelmed enough as it is and would rather get something they can use immediately."

Phase #2. Uncover the most effective value claim

After determining the most effective keyword group — marketing strategy — the team wanted to know which value claim best attracted potential visitors. For this phase, the team decided to focus its efforts on the MarketingExperiments brand instead of MarketingSherpa. This second phase mirrored some of the previous phase’s steps.

Step #1. Identify value claims to test

As part of value proposition development, MECLABS has identified eight potential claims of value for its MarketingExperiments brand. That significant difference allowed the team to feel comfortable focusing their upcoming efforts on that segment.

Powell ranked those potential claims of value and selected three he thought would have the most appeal and exclusivity in the PPC channel:
  • The largest public library

  • The first public library

  • The latest public library

Step #2. Craft PPC ads

Using those three value claims, Powell and his team crafted three PPC ads:

Find a Marketing Strategy
www.marketingexperiments.com
The largest public library of
tested marketing strategy on Earth
Best Marketing Strategies
www.marketingexperiments.com
The 1st ever public library of
tested marketing strategy online
Largest Marketing Strategies
www.marketingexperiments.com
The most-to-date public library
of tested marketing strategy online

Again, to isolate the test variable, each PPC ad used similar wording and structure.

Step #3. Test value claims

Powell and his team then set up the three ads to compete against one another in a split test.

Which value claim best matched the motivation of visitors searching for information about marketing strategies?

The "Best Marketing Strategies" PPC ad won by increasing clickthrough by 37%.

Powell said he believed the test resulted this way because "customers care more about authority than usefulness when searching for this type of help."

Phase #3. Discover the most effective usage of facts that support value claims

For the MECLABS team, Phase 3 incorporated some outside help. As part of a live test performed at Web Optimization Summit 2014, the audience was asked to help develop the test.

On day 1 of Summit, Powell provided the audience with background information to set the stage. The winner of Phase 2 would be the control for Phase 3 of testing.

Step #1. Craft PPC ads using evidentials

While using value claims can create broad messaging, using evidentials, or supporting facts, can provide a value claim more authority.

When asking the audience to craft their own treatment PPC ad, Powell provided them with the below list of facts about the company that could support the value claims:
  • Established in 1997

  • First report published in 2001

  • Offer Response Theory Validated in 2003

  • 10 heuristics (strategic guides) patented in 2006

  • 1,500 statistically significant experiments to-date

  • $20MM of published research to-date

  • Cited in 13,000 sources

  • 10,000 pages tested to date

The audience had free reign how they used those evidentials. They could use none, or they could incorporate multiple proof points into their ads.

Powell also provided them with a tool to craft those ads, the MECLABS Ad Optimization PPC Tool. It allowed the audience to quickly craft ads that adhered to formatting and character limits set in place by the search engines.

With all the tools and information they needed, the Summit audience gathered in groups and crafted treatments to submit to Powell and the team.

Step #2. Select PPC ad treatments

In total, the team received 50 ads from the audience. The team then narrowed that down to five treatments.

Powell described the reasoning behind the selection process: "The goal is not just to get a lift, but to get a learning. So we wanted it to be somewhat progressive or to be connected in a way that would give us a learning."

The audience was then asked to vote for one treatment, and the top two treatments would be tested against the control.

The Phase 3 test included the following three PPC ads:

Control
Best Marketing Strategies
www.marketingexperiments.com
The 1st ever public library of
tested marketing strategy online
Audience Choice 1
Best Marketing Strategies
www.marketingexperiments.com
Get 17 years of marketing research & 10,000 case studies for free
Audience Choice 2
Best Marketing Strategies
www.marketingexperiments.com
10+ patented strategic guides
1500+ proven tests. Free Access

Step #3. Test PPC ads

After settling on three ads, the team launched them by mid-afternoon on day 1 of Summit. A winner validated by the evening.

Audience Choice 2 had an 88% relative increase, with a 99% level of confidence. To know if the results were significant, Powell used the MECLABS Testing Tool.

RESULTS

We've covered the numerical results in each phase, but this series of tests was about more than relative lifts. The goal was to learn about MECLABS' customers. Powell reviewed this with the Summit audience.

"In both cases, the audience ads have a level of specificity the original ad doesn't. You can even argue that 'free' played a part," Powell said.

He then asked the audience, "Why did Choice 2 outperform Choice 1?"

"One underlying common denominator for each of these ads is authority. It seems as the perceived authority increased in the minds of customers, so did the results," Powell explained.

For the average marketers looking for strategy help, the evidentials provided in Choice 2 could appear to hold more clout or authority.
So do patented guides carry more authority than years of research? Do proven tests mean more in the mind of customers than case studies?

These are questions worth further testing. But it certainly shows an interesting discovery about the MECLABS audience. That's what the live test was about: demonstrating how valuable customer insights can be discovered in as little as two days.

Creative Samples

  1. MarketingExperiments homepage

  2. Keyword research

  3. Validation Tool

  4. Claims of value for MECLABS

  5. Ad Optimization PPC Tool

  6. Audience ad submissions

  7. Testing Tool

Campaign Team

MECLABS
Steve Beger, Senior Development Manager
William Duke, Marketing Manager
Taylor Lightfoot, Data Scientist
Jon Powell, Senior Manager of Research and Strategy
Alissa Shaw, Research Analyst
Brian Street, Research Manager
Aimee Thompson, Events Manager

Related Resources

Download the MECLABS Ad Optimization PPC Tool

Download the MECLABS Testing Tool

Value Proposition: Which of your value claims is most appealing to new customers?

Value Proposition: 3 steps for laying your value prop testing groundwork

Web Optimization Summit 2014 Wrap-up: Top 5 takeaways to improve your testing and optimization



Improve Your Marketing

Join our thousands of weekly case study readers.

Enter your email below to receive MarketingSherpa news, updates, and promotions:

Note: Already a subscriber? Want to add a subscription?
Click Here to Manage Subscriptions