July 23, 2008
Case Study

Dollars-Off Coupon Gets 170% More Revenue: 2 Simple A/B Test Steps

SUMMARY: Which email coupon works best to grab a shopper’s attention – “Dollars Off” or “Percent Off”? An eretailer analyzed these email coupons with a simple A/B split test and unearthed some interesting results. Two simple steps.

Please Note:
This article is only available until July 30th for non-members
Get unlimited access to this article as well as to 560 how-tos, more than 800 Case Studies, and 300 interviews just setup your MarketingSherpa Membership free 7-day trial.



CHALLENGE

Like a lot of email marketers this year, Nathan Decker, Ecommerce Director, Evo (formerly Evogear), sought to make the best out of the economic slump that has consumers tightening their purse strings. If that wasn’t daunting enough, Decker and his team were heading into their regular summer slowdown.

“It’s a lull time of the year for us, and we really wanted to augment sales,” Decker says. “Most of our email customers are repeats. We were looking for a more effective way to get them to come back and shop.”

The calendar already said April as well; they didn’t have a ton of time before their summer product emails starting getting sent out. “We had a full schedule of promotions in front of us,” Decker says.

They had seen an intriguing but mixed bag of results in past emails that utilized either a “$$ Off” or a “% Off” pitch to customers. But they had never directly tested the two pitches against each other. They wondered which of them would actually work best in this sobering economic climate.

CAMPAIGN

Decker and his team set up a simple A/B split test. Here are the two quick-and-easy steps they took for the test:

Step #1. Test upcoming email

Establishing a venue for the test was fairly easy for Decker and his team. They had an upcoming email coupon scheduled for one of their larger preference segments – people interested in products from the gear brand, Wake. They didn’t have to schedule a separate send.

“We felt like it was a particularly good email for us to target and get an accurate read on what may work best.”

Step #2. Create fair comparison

Decker and his team looked specifically at email sales metrics for their Wake brand segment to determine what offers would best suit the nature of the test.

“We definitely took the time to ensure that it was a fair comparison,” he says.

Based on their average order size, they chose $50 off a purchase as a reasonably good incentive that wouldn’t kill their ROI. Using the same parameters, they picked a 15%-off total purchase offer because it worked out to be the mathematical equivalent when it came to a percentage.

In the end, they pitted the “$50-off Coupon” vs. “15%-Off Coupon” in the subject line and the body copy.

“We had done a lot of percentage-off coupons and not as many from the dollar-off variety. I had a gut theory that one would perform better than the other and wanted to find out.”

Everything else in the emails remained the same. They also involved a coupon code, a 6-day, limited-time window and a follow-up 48-hour reminder email that employed the exact same “$50-Off Coupon” vs. “15%-Off Coupon” copy.
RESULTS

It was well worth the brief time it took to do the test for Decker and his team.

o $50-Off Coupon generated 170% more revenue than the 15%-Off Coupon.
o $50-Off Coupon had 72% higher conversion rate.

Since then, the dollar-amount offer has been helping Evo create sales during the tough summer-sales period.

“It turned out that the dollar-off coupon was a better way to position offers because the perceived value is higher for our customers. The ‘defined amount’ that you get turned out to be a much more effective incentive. Going forward, we are going to use the dollar-off [tactic] to drive more sales.”

Decker adds that eliminating the prospect of the recipient having to do some percentage math to figure out their savings also was a likely factor.

“The dollar-amount was simpler. And it was clear what the offer was from the second the person looked at. They didn’t have to think about it, and I think that has relevance.”

Interestingly, the slight copy difference in the subject line didn’t affect the open rates nearly as much as they did conversions. The $50-Off Coupon” got a 20% open rate; the 15% Off Coupon did almost as well with 19%. Also, the clickthroughs were nearly identical -- the 15%-Off coupon produced a 33% rate, while the $50-Off came in at 32.4%.

The 15%-Off Coupon did generate an average order size that was 44% higher . For that reason, Decker says, marketers who value average-order size due to their customer niche may want to duplicate the test to see if they get the same lift. Based on revenue, however, choosing between the two going forward was a no-brainer for Decker.

“In a down time or an up time, the finding would be applicable. But it has been especially beneficial to find something that works better when things are looking [economically] scary down the road.”

Useful links related to this article

Creative Samples For $50-Off Coupon vs. 15%-Off Coupon Test
http://www.marketingsherpa.com/cs/evo/study.html

Evo:
http://www.evogear.com

Constant Contact, Inc. – email services provider:
http://www.constantcontact.com

MarketingSherpa Special Report: Special Report: Part I: Online Coupons 101 - Redemption Data, Vendors, & How to Fight Fraud
http://www.marketingsherpa.com/article.php?ident=23528

MarketingSherpa Special Report: Special Report: Part II: Three eCouponing Case Histories: Land O' Lakes, Act II, and Krispy Kreme
http://www.marketingsherpa.com/article.php?ident=23536

Improve Your Marketing

Join our thousands of weekly case study readers.

Enter your email below to receive MarketingSherpa news, updates, and promotions:

Note: Already a subscriber? Want to add a subscription?
Click Here to Manage Subscriptions