The Top 20 A/B Testing Case Studies that Every Marketer Should Read

By Arun Sivashankaran

a/b testing, conversion

There are numerous ways in which testing, especially A/B testing or the more complex multivariate approach, can be used to help your business. From improving your copy to streamlining your design for the best possible user experience to removing friction from your checkout process, conversion rate optimization can help you improve the bottom line and reach your business growth and revenue goals.

One of the most common requests that I get is for case studies. Entrepreneurs and business owners are looking for examples of “how it’s been done.” These inside looks at testing can be helpful at every step of the process, from identifying what needs to be tested to creating hypotheses, from designing your tests to implementing the results in your business. Below is a selection of case studies from around the web that I’ve curated to help my readers and clients understand some specific aspects of the A/B testing process. What follows is a list of the tests, along with a quick description and what I think you can learn from them.

10120260443_560161d92b

Photo Credit: Todd Chandler via Compfight cc

On dealing with failure in testing

How Failed A/B Tests Can Increase Conversion Rates: As part of their ongoing series of case studies, Unbounce put together a terrific series of resources looking at what happens when A/B tests fail, and how you can apply those lessons to your own CRO efforts to actually improve your Conversion Rates.

Appsumo reveals it’s A/B testing secret: only 1 out of 8 tests product results: In this guest post, Noah Kagan of Appsumo shares brilliant insights on realistic ratios of testing success….and why that one win can transform your business.

On testing for pricing and packages

How Server Density A/B tested pricing plans and increased revenue by 114%: The pricing that your customers respond to isn’t always intuitive. This case study offers insights into why.

Basekit improves conversions 25% after redesigning price page: Basekit’s case study highlights a subtlety of pricing – it’s not just the pricing that matters, but the design of the pricing page.

Adding a free trial button doesn’t decrease paid sign ups – but increases trials by 158%: Sometimes our assumptions about what will distract customers is completely wrong. GetResponse’s case study is a perfect illustration of that fact.

Building a culture of testing

Testing is more just data: 3 tips for inspiring your team: Schedulicity has built A/B testing into the DNA of their business and created a culture of testing. Here’s a closer look at how they did it.

11 obvious A/B tests you should be running: Quicksprout’s Neil Patel offers a great guide to help you start conceptualizing which A/B tests might work for your business, complete with mini-case studies. If you’re introducing A/B testing to your team for the first time, this is a great place to start.

Leverage the power of proof

Adding testimonials skyrockets your conversion rates: This insightful post offers case studies and studies that underscore the importance of social proof in the form of customer testimonials. Testimonials with pictures tend to perform even better.

AMD achieves a 3600% increase in social sharing: Social sharing has numerous benefits, but social media shares is an important form of proof in today’s market. This case study follows AMD’s efforts that achieved an astronomical increase in shares and how you can do the same for your business.

Figleaves improves conversions by 35% by adding customer reviews: Customer reviews are a more “unfiltered” version of testimonials. According to a recap of this keynote speech, one change increased business by one third. The rest of the notes are also valuable and worth reviewing.

Lead generation and testing

comSCORE increases leads by 69% by adding a new customer logo: Increasing lead generation and prospect engagement can be as simple as a visuals or layout switch.

SafeSoft Solutions – prominent price display increases leads by 100%: How prominent should your pricing be? Could changing this simple display improve your leads and sales?

Hyundai improves requests for test drives with multivariate testing: Sophisticated brands and products sometimes requires more complex testing routines. Here’s a closer look at how Hyundai used multivariate testing to increase their test drive requests by 62%.

Video can dramatically improve lead generation and conversions: Unbounce’s case study on Vidyard shows the potential dramatic impact of video content on the page (6% vs. 11% or 13%).

Leveraging data for lift during web design

Spreadshirt’s data driven redesign lifts clicks 606%:  This case study provides an excellent example of how an ecommerce business used A/B testing to increase interest and sales (11% overall), through data driven web design.

Conversions increase when redesign focuses on customer flow: Zen Windows tripled their lead generation through a website redesign that focused on clear click paths for customers.

Removing one image results in a 400% increase in conversions: One company increased their conversions by 400% by removing a single visual – a “secure transaction” button. Learn more about this surprising case study.

Knowing your audience: when good design produces bad results: We always assume that a sleeker, sexier site will perform better. Uncommon Knowledge’s case study proves that nothing trumps knowing your audience.

Intuit increases conversions by 211% by adding chat: Simple changes in site functionality – such as making it easier for customers to talk with representatives – can have a huge impact on conversions.

Clean vs. clutter on internal page design: The cleaner design improved conversions by 197%. Are your inner pages cluttered or difficult to navigate?

Reviewing case studies can fuel your own ideas for testing program development, as well as develop your pattern recognition for solid testing opportunities. Is there a must-read case study that is missing from this list? Let me know (and include a link) in the comments below!

 

Improve your Conversion Rates with FunnelEnvy

From research & analysis to test and campaign development our optimization engineers will get your conversions headed in the right direction.

Learn About Our Services
  • Andy

    Great selection! I’d also recommend anything by Which Test Won. There’s a lot to sift through, but you can definitely gain a lot of knowledge if you can stick with it.

    • http://www.funnelenvy.com/ Arun Sivashankaran

      Thanks Andy. Yes, we’re big fans of Which Test Won. Appreciate the feedback!

  • Jake

    Some of the best case studies I’ve seen
    are on the blogs of some of the tech products that you use to conduct
    them, like Optimizely and Unbounce.

    • http://www.funnelenvy.com/ Arun Sivashankaran

      Thanks for the feedback Jake! Visual Website Optimizer has some great case studies as well.