eMarketing & Commerce (eM+C)

You will be automatically redirected to emarketingandcommerce in 20 seconds.
Skip this advertisement.

Advertisement
Connect
Follow us on
Advertisement
 

Advantages and Disadvantages of A/B Split Testing for Landing Pages

February 5, 2009 By Tim Ash
1
Get the Flash Player to see this rotator.
 

Marketers can increase their conversion rates dramatically — and in a short period of time — by testing alternative landing page designs.

There are two types of testing marketers can do: multivariate and A/B split testing.

With multivariate testing, marketers mix and match several page elements at once — such as headline, layout, images and call-to-action messaging — in an effort to determine which combination produces the best results. But multivariate tests can be complex to set up and analyze.

A/B split testing, on the other hand, is the most basic tuning method. The name comes from the fact that two versions of a landing page — “A” and “B” — are tested. “Split testing” then refers to the random assignment of new visitors to the version of the page they see. In other words, the traffic is split, and both versions are shown in parallel throughout the data collection period in equal proportions.

A/B split testing advantages
A/B split tests have several advantages, including these:

  • Useful in low-data rate tests. If your landing page has only a few conversions per day, you simply can’t use a more advanced tuning method.
  • Ease of implementation. Many software packages support simple split tests. You even may be able to collect the data you need with your existing Web analytics tools.
  • Ease of test design. Split tests don't have to be carefully designed or balanced. You simply decide how many versions you want to test and then split the available traffic evenly among them.
  • Ease of analysis. Only very simple statistical tests are needed to determine the winners. All you have to do is compare the baseline version to each challenger to see if you’ve reached your desired statistical confidence level.
  • Flexibility in defining the variable values. The ability to mix and match allows you to test a range of evolutionary and revolutionary alternatives in one test, without being constrained by the more granular definition of variables in a multivariate test.

A/B split testing disadvantages
A/B split tests also have their drawbacks, including these:

  • Limited number of recipes. While you may want to test dozens of elements on your landing pages, because of the limited scope of split testing, you have to test your ideas one at a time.
  • Inefficient data collection. Conducting multiple split tests back to back is the most wasteful kind of data collection. None of the information from a previous test can be reused to draw conclusions about the other variables you may want to test in the future.

Despite these drawbacks, if you’re new to landing page optimization, A/B split testing is definitely the way to start. Because of its simplicity and the availability of free tools, it’s easy to begin down the road of improving your conversion rate.

 
1

SPONSORED CONTENT

MORE ON E-COMMERCE >>

FROM THE BOOKSTORE

To meet the demands of today's socially connected donors, this new edition explains how to mesh today's online technologies with direct mail to produce optimal fundraising results. The book includes current research on timely topics such as:  online vs. offline behavior online giving statistics demographicsbest practices in integrated fundraising, and more How to Write Successful Fundraising Appeals, 3rd Edition

To meet the demands of today's socially connected donors, this new edition explains how to mesh today's online technologies with direct mail to produce optimal fundraising results. The book includes current research on timely topics such as:
online vs. offline behavior online giving statistics demographicsbest practices in integrated fundraising, and more...

ORDER NOW

(PDF Download)

Direct mail, email, mobile, social media, video, search ... the marketing landscape can either be a minefield where mistakes can kill campaigns, or a perfectly integrated mix of channels that maximizes the reach of the message and gives a nonprofit the best chance to capture more donor dollars.  

<b>In <i>"The Art & Science of Multichannel Fundraising" </i> from DirectMarketingIQ, the roadmap to that "perfectly integrated mix" is thoroughly laid out in over 130 pages -- <u>it's specifically created (and priced) for nonprofits</u>. </b>
  
First, 9 chapters from leading fundraisers give you the latest best practices in multichannel fundraising, including how to:  

• Choose the right channels for your campaign 
• Develop creative that works across multiple channels 
• Revitalize the direct mail component of your multichannel mix 
• Make sure email plays its increasingly important role perfectly 
• Seamlessly integrate mobile marketing into the fundraising campaign 
• Boost your online strategy with social media 
• Create a multichannel donor renewal campaign 
• Figure out that you're doing right — via testing and results measurement 
• Use all the pieces of the multichannel puzzle  

Second, in 8 robust case studies, find out the secrets behind multichannel fundraising campaigns that worked.

About DirectMarketingIQ
The Research Division of the Target Marketing Group, DirectMarketingIQ (www.directmarketingiq.com) is the marketers’ go-to resource. Publishing books, special reports, case studies and how-to-guides, it opens up a new world to those who seek more information, more ideas and more success stories in order to boost their own marketing efforts. DirectMarketingIQ has unparalleled access to direct marketing data – including the world’s most complete library of direct mail as well as a massive library of promotional emails across hundreds of categories – and producly produces content from the most experienced editors and practitioners in the industry.

<b>Note: You must have Adobe Acrobat Reader in order to read , The Art & Science of Multichannel Fundraising which is in PDF format.</b> The Art & Science of Multichannel Fundraising

(PDF Download) Direct mail, email, mobile, social media, video, search ... the marketing landscape can either be a minefield where mistakes can kill campaigns, or a perfectly integrated mix of channels that maximizes the reach of the message and gives a nonprofit the best chance to capture more donor dollars....

ORDER NOW

 

COMMENTS

Click here to leave a comment...
Comment *
Most Recent Comments:
Rex Dixon - Posted on January 22, 2010
Have you checked out Performable yet? They are in closed beta - http://www.performable.com/ but are working together with another A/B Testing site - http://www.abtests.com/ ?
Click here to view archived comments...
Archived Comments:
Rex Dixon - Posted on January 22, 2010
Have you checked out Performable yet? They are in closed beta - http://www.performable.com/ but are working together with another A/B Testing site - http://www.abtests.com/ ?