For more goodness, Follow us on twitter

Be careful what you ask for. How 2 words dropped CTR 36%!

Posted: November 16th, 2010 | Author: admin | Filed under: Optimization | 26 Comments »

I found this insanely surprising so I thought you’d be curious what happened.

We send out a few thousand emails every time we launch our new bundles. Our emails look like crap. Here’s what they look like:

I asked a design buddy to sexify it and here’s what turned out:

Notice anything? I didn’t either but our original had a CTR of 22% and our new one only got 14%. That’s massive when a majority of our sales come from our list.

So wtf? Let’s go to the root. Clicks dropped and luckily MailChimp shows you where people clicked. That is where we found some gold.

Eeks. 60% of clicks in our original email happened in the top section. In the new version as you can see the photo the click % of the new top was really low. Clearly we were scaring people away.

Solution = Change wording.

In our recent emails we changed the wording to “See it.” Things are better :)

Take away.

  • Be aware where in the process your customers are. Buying vs learning are two completely different things.
  • Sexy doesn’t always mean more money. Track large changes and see the real impact.

Get a free app and our next deal emailed to you!

26 Comments on “Be careful what you ask for. How 2 words dropped CTR 36%!”

  1. 1 King Sidharth said at 11:41 am on November 18th, 2010:

    RED call to action button?!
    Woah dude, get a UI designer. Not decorators.

  2. 2 Jim said at 11:42 am on November 18th, 2010:

    The new version looks more like a typical ad or marketing piece. The original looks more like a message with content.

    The former I usually delete on sight. The later I might read more carefully.

  3. 3 Rishi said at 11:44 am on November 18th, 2010:

    very cool – Did the original version also have higher # of purchases?

  4. 4 admin said at 2:03 pm on November 18th, 2010:

    Good question. Conversion rate on the landing page was the same so the old one sold more.

  5. 5 admin said at 2:03 pm on November 18th, 2010:

    Interesting. How can we make it better? I was thinking of putting more stories and reasons why we chose the services we did. What do you think?

  6. 6 admin said at 2:04 pm on November 18th, 2010:

    Haha. Care to help. What color should we change it to?

  7. 7 Koichi said at 2:13 pm on November 18th, 2010:

    @King
    In a lot of tests I’ve seen done (and tests I’ve done myself), red actually does a really good job converting and getting clicks. The whole “red=stop” thing is BS, in my experience.

  8. 8 JohnH said at 2:15 pm on November 18th, 2010:

    “We got a” tells me don’t buy, since the grammar is poor — what else is wrong?

    You mean “we’ve got a”.

  9. 9 admin said at 2:16 pm on November 18th, 2010:

    @JohnH haha. Good catch. No more writing at late night.

  10. 10 Jeremy said at 2:20 pm on November 18th, 2010:

    Try “Learn More” rather than “See It”.

    My wife spent several years in marketing at Intuit where they usability tested everything and she said “Learn More” had an uncanny knack for beating almost any CTA.

  11. 11 Brian said at 2:27 pm on November 18th, 2010:

    Green works very well. We saw an increase in click thrus switching from Red to Green buttons.

  12. 12 Jonathan Mendez said at 2:53 pm on November 18th, 2010:

    Koichi is right, the red=stop thing is crap. Overall, as a best practice, red is the best color for buttons (just like blue is the best color for links). You can & should perform your own tests but I’ve tested across tens of millions of people in every vertical and way more often than not red wins.

    btw, ugly usually wins too…

  13. 13 King Sidharth said at 3:07 pm on November 18th, 2010:

    @Koichi:
    Test!
    Call to action in red never returned better conversion than green for me.

    Can vary case-to-case so did you test the two here?

  14. 14 brookr said at 3:45 pm on November 18th, 2010:

    Anyone who tells you that surely one color or another will/not work for your site, without actually doing any testing, is full of it.

    Especially with colors, what works on one site has zero correlation to what works on your site, with your customers, in the context of your emails. Principles translate (like, contrast, emphasis, language hints, etc). But absolute values are completely contextual.

  15. 15 Chris Beaman said at 3:46 pm on November 18th, 2010:

    Why don’t you run some A/B tests? Mailchimp has solid split testing functionality. How big is your list?

  16. 16 Kevin said at 4:11 pm on November 18th, 2010:

    I think it has more to do with the wording versus the design. “buy now” is way too much of a committment. I would try the new design with “learn more” as suggested above. I’d be interested in any changes yo incorporate. Great post, thanks for sharing.

  17. 17 drawcode said at 4:24 pm on November 18th, 2010:

    It might be the red in addition per other comments. See how other buy buttons are call to actions that aren’t red (translating to stop/error). Firefox for instance uses bright green, http://www.mozilla.com/en-US/firefox/firefox.html Google uses blue. The word changing is definitely useful obviously but the red really gets to me. Almost too powerful of a call to action.

  18. 18 bb said at 4:48 pm on November 18th, 2010:

    You’ve also changed the flow which may be hurting.

    In the original you have benefit list -> commitment. It’s easy to skip the first link (which hurts nothing), read the bullet points, see a price then roll into the learn more link.

    In the rev you have commitment -> benefit list. You get hit straight up with a cost with nothing to support why you’d spend it, the italic blurb is visually muted (ie, skipped) then a big “COMMIT!!” button, which at this point, I have no reason to.

    I’d put “What’s inside” first, kill the blurb, move the cost closer to the commit action and tone down the button’s wording / visual style a bit.

  19. 19 Vitaly M. Golomb said at 5:07 pm on November 18th, 2010:

    Multiple studies show that contrast of the CTA to the background is #1. Red converts more than green usually. Wording is key. Need an attention getter, leading summary and CTA (usually “learn more”). Blatant “buy this” scares people off.

  20. 20 Customers don’t want to commit early: How 2 words dropped CTR 36%! said at 7:09 pm on November 18th, 2010:

    [...] the full thing at: Be careful what you ask for. How 2 words dropped CTR 36%!. · · · ◊ ◊ ◊ · · · Leave a Reply Click [...]

  21. 21 Troy said at 7:34 pm on November 18th, 2010:

    I totally wouldn’t click, because I would think its a shopping cart.

    But hey, how did your conversion rates change? That’s all that matters at the EOD. Hard to do a long-term test, but it would be interesting to see your short term results.

    http://tech.rawsignal.com

  22. 22 Shanon said at 7:45 pm on November 18th, 2010:

    I agree with bb.

    Some thoughts:

    1) You now place a much larger emphasis on price.
    2) You no longer mention the deal expires in a few days.

    It feels more like an everyday purchase than a scoop.

  23. 23 Tweets that mention AppSumo Blog » Blog Archive » Be careful what you ask for. How 2 words dropped CTR 36%! -- Topsy.com said at 12:42 am on November 19th, 2010:

    [...] This post was mentioned on Twitter by yongfook, noah kagan, Andy Murdoch, MattCerto/WebSolvers, Jeff Gackenheimer and others. Jeff Gackenheimer said: Small changes to a CTA can make a big difference http://bit.ly/c35aeq [...]

  24. 24 Misty Funk said at 12:58 pm on November 19th, 2010:

    Wow! Great article…and like when making a recipe, I learn much from reading the “reviews” (here noted as comments). It’s so amazing how tiny details can make the difference in many dollars!

  25. 25 Robin said at 4:22 am on March 25th, 2011:

    You can also show a screen grab image of what you are talking about. some visual elements to show people what they will see if they want to learn more is really useful.

    In email marketing test I run through Dot.Mailer, Mailchimp and others, I get higher click throughs on the images themselves than only relying on buttons.

    Give it a try and keep split testing. Good luck, thanks for sharing your results!

  26. 26 Daily Digest für March 28th, 2011 — Amys Welt said at 1:17 am on March 28th, 2011:

    [...] Be careful what you ask for. How 2 words dropped CTR 36%! [...]


Leave a Reply