VWO Testing
A/B Testing

A/B Testing Solutions to Maximize Your Website Conversions

Create and A/B test different versions of your website and its elements to continuously discover the best-performing versions that improve your conversions.

Know More
VWO GDPR Ready Badge
VWO CCPA Ready Badge
VWO G2Crowd Leader Spring Badge
VWO BS 10012 Certification Badge
SOC 2 logo
Follow us and stay on top of everything CRO
Related content:

A/B Testing For Pricing & Split Testing For Pricing? – Here is How to Do It

7 Min Read

Oh, the question thou fear the most:

At what price should I offer my new product X?

Determining the right price for your product is perhaps one of the most difficult tasks when you are launching a new product or service. Pricing for physical goods is simple. For example, if you are manufacturing staplers, all you need to do is calculate the cost of production and distribution, slam a 20% margin on it and there you have the price you can sell your shiny stapler machines for.

Table of Contents

Download Free: A/B Testing Guide

Economics 101 (Price Elasticity Of Demand)

But for digital goods with no cost of production, it is not that simple, unless you test your pricing with multiple margins. This zero cost of production complicates pricing decisions because then you need to price the product according to the perceived value of the product in the market. At the core, the idea is quite simple: the higher the price, the lower the demand. However, if the price is too low, you won’t make a lot of money even though you might sell a lot. Similarly, if the price is too high, you won’t make a lot of money even though each unit sold brings you a greater amount of money. This is the basic principle of price elasticity of demand.

Blog Banner: VWO Spilt testing
A/B Testing For Pricing & Split Testing For Pricing? -  Here is How to Do It Image
Image source: Ingrimayne

As you can see in the graph above, increasing the price by 10% led to a 15% reduction in the quantity bought which reduced total revenues. Every product has a price point in the graph at which revenues become maximum. If you price it higher, the revenues will fall. If you price it lower, the revenues will fall. Of course, you can’t sit over coffee one evening and draw this price-demand curve for your product. It has to be discovered. Your market determines this curve and A/B testing is an excellent way to find out which price point maximizes the total revenue.

A/B Testing For Pricing: How to set a price range?

Theoretically, the price-demand curve is infinitely long. Price runs from zero to infinity (Y-axis) and so does demand (X-axis). But, of course, practically you need to have a price range in mind that you think is suitable for your product. For example, if you are selling an eBook, you need to see if $15 gets you more revenue than $9. And you would probably be wise enough to avoid testing selling it for $100. The key question here is: how to set the initial price range for price testing?

cover image of the ebook don't just roll the dice
Image source: Google Books

The answer is: don’t just roll the dice. Even though science says that it is about software pricing, I have found it applies to many types of digital products. The basic gist is: to look for other similar products in the market and also look at the value your product is delivering. Set a price range accordingly. Once you have a price range in mind (say $50-$150), the next step is to use A/B split testing to determine the exact price that maximizes revenues.

Split Testing for Pricing: The dark art of price testing

Price testing is one of the most difficult projects you can undertake. There are so many things that can go wrong. Consider this scenario: an influential blogger (say Mike from TechCrunch) is trying out your product and somehow gets to see that you are doing price testing. He writes about it on the blog (because, hey, it is fun to write about something controversial). Reading this post angers your customers. Worst-of-the worst, one of the customers turns out to be an idle lawyer and sues your company. It is a worst-case scenario but quite plausible.

To avoid the “OMG, we got sued due to price testing” scenario, you should be doing price testing according to the following rules (which I classify as the good, the bad, and the ugly — in the reverse order).

The ugly: never offer the same product/service at different price points

Yes, you read it right. This is perhaps the way many companies do price testing but you should NEVER show different prices to the visitors for the same product or service.

an example of bad SaaS pricing plan strategy

It’s illegal and can lead to a huge lawsuit.

The bad: have slightly different offerings for different price points

This is a less nefarious version of the plain-old price testing. Instead of showing different price points for the same product, you show different price points for slightly different product offerings. You can vary product offerings tested at different price points by adding or removing some trivial features. I will give you an example, if you are selling a backup service, you can create one version where you offer 5 GB storage for $20, in another version you offer 5 GB storage + SSL (trivial feature) for $30. Practically both offerings are similar but technically there is a difference and if anyone ever questions you, you have grounds for justifying the price difference. After all, you are offering different products (no matter how trivial the difference is).

an example of good SaaS pricing plan strategy

But I consider it immoral. Yes, you can evade potential lawsuits but anyone can tell that you are fooling people.

Download Free: A/B Testing Guide

The good: offer different products (or plans or solutions) at different price points

This is the most ethical way to do price testing. Ideally, you should offer completely different product plans at different price points. Taking backup service as an example again, if on your pricing page, the lowest tier offers 5 GB for $20, test a version where you offer 10 GB for $40 and 2 GB for $8. You are trying to gauge the sensitivity to price here. If your conversion rate for 10 GB is the same as that for 2 GB, this means your service is so compelling that people don’t care if it is $8 or $40. So, in the next update, you ramp up the price to $40 for 5 GB (while still grand-fathering old customers). This way you would know what is the best price point for your service.

an example to highlight what to include in SaaS pricing plans

Of course, not all digital products have the luxury of offering pricing plans. What if you are selling an eBook? In that case, you need to add some extra value (e.g. 15-minute consultation with the author) if you are trying to test a higher price and remove some value if you are trying to test a lower price (e.g. shorter version of the ebook).

The key lesson for using A/B testing to determine the ideal price is this: offer different values at different price points to gauge the sensitivity of the target market. Then whatever price offers maximum revenue, start offering your main product at that price point (while grand-fathering old customers).

Blog Banner Ab Testing

Final gospel: measure revenue, not conversion rate

I have suggested it earlier in the article but will make it clearer here. During price testing, you should measure the revenue (not the conversion rate). Because even though you may end up selling less (hence the lower conversion rate) at higher price points, your total revenues may actually be higher.

VWO lets you measure revenue by integrating with Google Analytics and Omniture SiteCatalyst. So, if you are measuring revenue in one of these analytics tools, you can easily see which price variation resulted in maximum revenue. (Even if you measure revenue in an internal dashboard or Excel, it should be quite simple to measure it for different variations)

So, are you ready to do some price testing?

Let me know your comments and feedback on the strategies I suggested. If you need help in setting up a price test using VWO, we will be happy to discuss it with you. Do email us at marketing@vwo.com.

Banner Ab Testing

FAQs on A/B Testing Pricing

What are some of the price testing methods?

Some of the price testing methods include asking the beta users of the product about the price, looking at what competitors charge, and doing research on products in complementary industries.

Is it illegal to a/b test pricing?

If you offer the same product/service at different price points. Then, yes. it’s illegal and can lead to a huge potential lawsuit.

Paras Chopra
Paras Chopra I started Wingify in early 2009 to enable businesses to design and deploy great customer experiences for their websites and apps. I have a background in machine learning and am a gold medalist from Delhi College of Engineering. I have been featured twice in the Forbes 30 under 30 list - India and Asia. I'm an entrepreneur by profession and my curiosity is wide-ranging. Follow me at @paraschopra on Twitter. You can email me at paras@wingify.com

Comments (9)

  1. Good read!

    Would you be able to point me to a ressource where I can read about setting up revenue as a goal in VWO using Google Analytics integration?

  2. AWESOME post Paras!

    I love the way you explained the correct way to do price-testing… brilliant!

    Also, I’d like to add 1 thing.

    If you’re just starting out, I think only testing which has the highest revenue is the best way.

    However if you have a more robust company – testing to determine the highest CUSTOMER LIFETIME VALUE is probably the best way (depending on various factors).

    Jeremy Reeves

  3. Maybe I should clarify:

    I have VWO up and running with Google Analytics integration and the website is sending Ecommerce data to Google Analytics.

    Do I setup the test in VWO and read the revenue amount for each variation in Google Analytics to determine the winner?

  4. In your third example both prices equated to $4 per gig of data. How do you conclude that you should charge $8 a gig just because more people paid $40. Isn’t it possible people just liked to buy in bulk?

    1. @Chad: yes, that’s precisely what we are going to test here. How sensitive is your target market to prices irrespective of how you value it.

  5. Greetings! Very helpful advice in this particular post! It is the little changes that make the largest changes. Thanks for sharing!

Leave comment

Your email address will not be published. Required fields are marked *

More from VWO on A/B Testing
5 Features Of A Highly Converting Pricing Page

5 Features Of A Highly Converting Pricing Page

Note: The article is written by Dave Schneider, cofounder of NinjaOutreach. Any and all opinions…

Read More
Dave Schneider

Dave Schneider

7 Min Read
How To Do A/B Split Testing on Low Traffic Sites

How To Do A/B Split Testing on Low Traffic Sites

What does ‘low traffic’ really mean? How much traffic does it refer to? On a…

Read More
Smriti Chawla

Smriti Chawla

9 Min Read
How to Calculate A/B Testing Sample Sizes?

How to Calculate A/B Testing Sample Sizes?

(This post is a scientific explanation of the optimal sample size for your tests to…

Read More
Kees Schippers

Kees Schippers

14 Min Read

Scale your A/B testing and experimentation with VWO.

Start Free Trial Request Demo