5
9 Comments

Here's why you HAVE TO split test (+52% screenshot incl.)

Yes I'm know the experiment is still in it's infancy but that's not the point.
The point is to remind everyone that you HAVE to test. A/B testing is thrown around all the time but I'm yet to see many people actually practice it. Especially smaller scale teams and makers.

I'm currently running a split test on a product we launched a couple weeks ago. I'm a marketer turned designer turned founder. For the last decade I've launched over 70+ products and I've seen a lot of failures and successes.

Anyhow what I wanted to show you is a screenshot of a VERY EARLY experiment. We're drip-feeding customers to our landing page and split-testing it. We try to get 80-90% confidence level before we ramp up the budget and knock things out the park.

Our product is selling at $100AUD. With a +52% lead in CR we're looking at $1,600 more for every 1000 visits we drive to this page. $16,000 fo revery 10,000 visits to the LP. Imagine the opportunity when you scale it.

My reminder to you all is to ALWAYS split test.

Don't be lazy. Don't be naive. Let the data speak for itself.

Happy shipping!

Tools: Google Optimize, Webflow

PS. If you want to follow what I'm working on, just follow me on Twitter @ Mizko.

on November 12, 2020
  1. 2

    Nice CR. Not a lot of people actually wait to see the effectiveness of split test before even ramping it up.

    Your data is superb and with that I'll advice you run a heat map also on each landing page to see where you'll optimize to get better conversions too. You'll be amazed how much you'll surpass your set mark... (I've done it) 😉

    Once again... Superb one, mate. ☺

    1. 1

      100% agreed. We have Hotjar running which will be useful in a few weeks time.

  2. 1

    Google optimize is super solid! Nice work!

    1. 1

      Thank you!! Yes it’s so simple to use

  3. 1

    Statistically significant? I think not.

    1. 1

      100% agreed hence the first 3 sentences. Will let this run for a few more weeks and then reassess.

  4. 1

    Nice boost in CR

    Just dmed you :)

    1. 1

      Thanks! Got it.