1
0 Comments

Curious, are you A/B testing? (+ my results)

I ran my first experiment a couple of months ago, with around ~120 users. It's questionable whether you can trust the results from such small numbers but I had to move on (make changes to the affected area). At this point I'm just playing with this new toy (the ability to experiment) so it's not the main driver behind my decisions. (I don't have enough traffic.)

Btw. the experiment was about teaching users how to use the service - which is a no-code website builder that you can also code if you need special features.

One of the cool things is that I accidentally ended up building a platform that allows me to run many concurrent experiments. What I mean is, have many experiments (many A/B tests) that run randomly on visitors, without extra complexity. Like, start a new branch, make a change, assign it to an experiment, done. Will be curious how big of a difference this will make.

Are you running A/B tests? If yes, how many users/visitors did you have when you started? Any takeaways worth sharing?

on March 23, 2021