5
9 Comments

Privacy friendly A/B Testing - Is this even possible?

I recently made the painful experience of restricting my A/B-Testing measures for privacy/legal compliance reasons and since then I wonder if there is a way to do useful A/B-Testing in a privacy friendly (and GDPR compliant) way. In other words that means doing A/B-Testing WITHOUT using cookies.

Do I miss out on any existing solution? Have you figured out a custom one for yourself? I'm happy to hear about your experience with this problem!

on March 26, 2021
  1. 2

    Should be possible for landing pages.

    You just sum the total page views vs events taken on the page.

    Take a look at https://plausible.io/

    If you wanted to ab test the home page you can as well but that would be a little more complex.

    1. 1

      Thanks for the advice, Volkan! Could you explain a little bit more, how to approad ab tests with plausible.io? For now I‘v been using Google Optimize but cannot see much similar features in plausible. Do you have experience in playing out and analyzing your variants with plausible?

      1. 1

        It is a hack on top of plausible.

        What are you trying to ab test? (home page or landing pages)

        1. 1

          My Homepage is my landingpage...I‘m looking for a solution to use on all of my pages. Could you tell me more about the hack? 🤓

          1. 2
            • Load version A or B (you can use JS to change the page)
            • Fire event saying page-a or page-b
            • On submit email/click click-a or click-b

            Use a online ab testing significance tool to workout the results of the ab test

            It isn't easy but it is possible

            1. 1

              Thank you Volkan, I will try this out 🙏🏼

  2. 1

    I'm actually working on a side project, which could be exactly what you need. If you want to collaborate or have a chat feel free to mail me at [email protected]

  3. 1

    Hi Niklas,

    I have implemented A/B testing functionality in my userTrack analytics platform and it has been beta for a while (mostly because small businesses rarely A/B test stuff so I haven't received a lot of feedback).

    I am using localStorage to store which variant the user saw, and provide the same variant next time he visits the page. This shouldn't pose any GDPR concern as there is no data sent to 3rd parties and and the data stored is only used for providing functionality.

    There is a visual A/B test creator where you can select a text on your page and replace it with a different variant and it will work automatically without any code. This works very well for testing copy on static landing pages.
    Another option would be to actually serve different content from the server-side based on the variant being viewed but depending on your current stack it might be harder to do.

    Let me know if you have any A/B specific questions!

    1. 1

      The GDPR talks about any method of saving a piece of data.

      It doesn't matter if you use cookie or local storage, consent must be asked.

  4. 1

    This comment was deleted 3 years ago.

Trending on Indie Hackers
I'm a lawyer who launched an AI contract tool on Product Hunt today — here's what building it as a non-technical founder actually felt like User Avatar 150 comments A simple way to keep AI automations from making bad decisions User Avatar 65 comments Never hire an SEO Agency for your Saas Startup User Avatar 55 comments “This contract looked normal - but could cost millions” User Avatar 54 comments 👉 The most expensive contract mistakes don’t feel risky User Avatar 41 comments I spent weeks building a food decision tool instead of something useful User Avatar 28 comments