How Are You Doing A/B Testing
I have been having lots of trouble with implementing split testing so I am pleading to you guys here, this is a bigger issue than the CRO community can address. We have tried using Google Optimize but since it loads the test after the dom is loaded there are those wacky flashes--which the rest of our devs aren't ok with. We dabbled with anti-flicker stuff but I don't beleive that is a good idea either (and that is backed by Simo Ahava). Also, we don't have a budget for VWO or Optimizely and don't even know if that will solve the issue.
Has anyone here had any experience with split testing? The website in question is https://cycle.io if you want to inspect it or something, but currently we do not have any tests runnning because of these problems.
Thanks so much!
Depends on what you want to test, to test just copy/small style changes I use my own analytics tool, which does change the DOM when loading, but to avoid flashes hides the DOM until the changes are made and loads the A/B test file synchronously but the analytics file async. If you care about 500ms extra loading/rendering time the only solution would be to have server-side A/B tests where the user receives directly the correct version.
split.io has a free plan which should cover regular A/B testing
Thanks! I'll definitely check them out! Are they mostly focused on feature flags?