Which variant do you think will win our A/B test?
A couple weeks ago I did a survey to see if people could guess which variant won our A/B test. I got such good feedback I wanted to share this time before I put the test live, so I can actually use that feedback. Will share the results as soon as it's done.
This one is a landing page for one of our features. For reference, we are judging this based on sign ups.
Two completely different approaches:
a) https://www.gosquared.com/smartgroups
b) https://www.gosquared.com/user-smartgroups
So which one do you think is better and which do you think will win?
Thanks for any feedback!
Update:
Just thought i’d share the results of this. Variant A one, pretty convincingly. All sign ups came through that variant. Interestingly though I was also tracking a secondary goal of people that made it to the sign up page. 70 / 30 split there for variant A.
Only driving traffic via Facebook, Twitter, and Google Ads. Not surprisingly, all sign ups came from Google ads.
Hi @russellvaughan, I like the design of the B one but I rather use the A! It looks clearer to me and that's appealing. The B variant has a more attractive visual identity, I think it's more memorizable in this way but the copywriting is less powerful. As it is often the case, maybe the solution would be to get the most of the two variants by mixing the A structure & copywriting with the B design, colors & illustrations? 🤔
Update:
Just thought i’d share the results of this. Variant A one, pretty convincingly. All sign ups came through that variant. Interestingly though I was also tracking a secondary goal of people that made it to the sign up page. 70 / 30 split there for variant A.
Only driving traffic via Facebook, Twitter, and Google Ads. Not surprisingly, all sign ups came from Google ads.
There is a typo/awkward sentence here, remove the "you" or "that", I'd say remove "that" so the word isn't repeated:
"One of the biggest challenges with metrics is you that can forget that behind the metrics are real people."
This copy is so hard to read IMHO
Analyzing the two pages:
A) has social proof, clear headings, talks about issues of segmentation, big screenshots
B) issues of segmentation but it talks more directly to the user, easier to read to scroll through the page IMHO
however...
A) has text that is harder to read (doesn't flow as well as B); has social proof way too deep into the bottom of the page
B) hard to see screenshots and the images dont make sense logically to me - like come on...at least spend some time on researching some good imagery please!
btw I dont get this:
This part doesnt make any sense to me
Ah!! Great spot thank you for the noticing that typo. I've updated that.
My vote goes for A) just because it looks more traditional, and traditional works for most! That's why we all drive cars with 4 wheels mostly ;)
I think so to, but I thought our previous pricing page variant was going to win and I was wrong on that. Excited to see what happens on this one. Thanks again for your feedback.
how much traffic did your A/B test get in total?
Great post!
I'd be shocked if it's not A.
This was our view on our pricing page experiment, but when we put it live, the most sign ups we got were through the variant we didn't think would win!
Being one of the team and intentionally staying a little distanced from this, I am genuinely not sure – both have pros and cons. I am excited to see which wins out 😅
Was blown away by the valuable IndieHackers responses to the last AB test post you did, Russell!