How many A/B tests do you run every month?
How about every year?
Now. How many tests should you be running every year?
You probably don’t know the answer to the third question.
You’re not alone – most people can’t answer that with confidence.
If you are like most people, you probably launch one or two A/B tests every month – meaning that you perform less than 30 tests per year.
Studies show that only a few companies run more than 15 tests every month. That’s understandable, considering how demanding it can be to build a high-velocity A/B testing program.
Remember, any time you aren’t A/B testing A/B testing, you’re wasting an opportunity to increase revenue and gain valuable insights that can lead to growth.
Most businesses sabotage their growth by running fewer tests than they're capable of.
Use the formula below to calculate your actual testing capacity:
52 weeks ÷ average test duration x the number of pages you can test
Having a consistent testing program without compromising on quality takes time. Booking.com live and swear by A/B testing – they launch over 24k tests every year. At some point they had 1000 A/B tests running concurrently.
From 2010 to 2012, Twitter moved from 0.5 tests per week to 10. And in that period they grew rapidly. Coincidence? I don't think so.
PS. The best way of increasing your testing velocity is to start slow. Make sure that you use reliable and testing tools testing tools that have advanced features.