I had a few landing page copy options in mind that I thought might resonate with my product's users. The problem is that I don't have enough traffic on my landing page to A/B test on the landing page.
So I thought I would try Twitter ads to AB test a few options.
I created three different ads with the following copy in them. Everything else remained identical.
Option A: You start small, ramping up your AWS usage over time. Eventually, your AWS bill shocks you. Billgist sends you a daily snapshot of your usage. Don't let your AWS bill surprise you.
Option B: Your account's financial owner doesn't have visibility into your AWS usage. The end of the month AWS bill shocks them. Billgist sends a daily snapshot of your usage. Don't let your AWS bill surprise you.
Option C: Your developer is experimenting with new services without understanding how it impacts your bill. Your AWS bill surprises you both. Billgist sends a daily snapshot of your usage. Don't let your AWS bill surprise you.
I then ran the ads for a few days and got the following results.
Click rate: 0.30%
Click rate: 0.16%
Click rate: 0.05%
Then I plugged in the values in this ab test calculator.
The results: Test "A" converted 545% better than Test "C". I am 100% certain that the changes in Test "A" will improve your conversion rate. Your A/B test is statistically significant!
Curious if any of you have done anything similar. Would love to hear feedback on whether this seems reasonable or if I can improve my tests a bit more.