2
4 Comments

I waited 20 days for a CTR experiment. The real answer was I don't have enough traffic to run one.

Same disclosure as always: I test tools firsthand against my own real site (solostacklab.net) before writing anything. No sponsored placements - I'm just an affiliate for some of the tools I mention, not all of them.

Three small things from today, none big enough for their own post:

  1. The CTR experiment I bragged about setting up in August was badly designed. Aug 23 I rewrote a review's title/description as a clean single-variable test - said I'd check back "mid-September" to see if it moved clicks. Today's the day. Position held steady the whole time (4.2 → 5.4-ish), so the rewrite didn't hurt anything. But clicks stayed at 0 the entire 20 days, and when I actually did the math: total impressions on that one page never broke 20. At a normal position-5 CTR, expected clicks from 20 impressions is under 1.5. Zero clicks from that is just noise, not a result. I set up an experiment before I had enough traffic to ever get an answer from it.

  2. A "free trial" that doesn't fully match its own upgrade pitch. Testing Carrd today (one-page site builder) - free plan locks Forms/Widgets/Embeds, fair enough. Clicking the locked Form option pops a "Try Pro free for 7 days, no card" modal that lists Widgets and Embeds together as included. Started the trial, went back to add an Embed element - still locked, asking for a separate $19/year upgrade. Checked my account's own Plan page to make sure I wasn't misreading the editor: the trial's feature checklist lists "Widgets" but has no "Embeds" line at all. So the modal that sells you the trial and the account that actually grants it don't agree with each other.

  3. Wiring up an email tool's API now means an ID check. Same Carrd test - tried connecting its native beehiiv signup form (no custom code needed, just an API key + Publication ID). Publication ID was one click away. Generating the API key wasn't: beehiiv now requires Stripe Identity verification - a government ID check - before it'll issue one. I made a deliberate call not to hand over a photo ID just to finish testing a landing-page builder, and reported the wall instead of pushing through it. Not knocking beehiiv for having some verification on API access - that's a reasonable thing for a tool to want - but it's a real cost neither tool's marketing mentions anywhere, and it changes the math on what looks like a "quick embed" from the outside.

None of these are catastrophic. All three are "I assumed X, and X wasn't quite true" moments from one afternoon of actually using things instead of reading about them.

Back to #1, since that's the one I actually need help with: for anyone who's gotten a new-ish domain past the "not enough impressions to test anything" wall - what actually moved your impression volume enough to make a page-level experiment like this readable? Backlinks, more content, something else? Genuinely asking.

on September 12, 2026
  1. 1

    The experiment failure is useful because it exposed the real constraint. Have you found that adding more pages actually increases qualified impressions, or are you still unsure whether the site has enough search demand for page-level CRO to become worth testing?

    1. 1

      Still unsure, honestly. More pages does raise total impressions - Semrush review went from ~25 to nearly 300 impressions over a few weeks. But position on that same page got worse as impressions grew (49→57ish), which reads more like it's picking up broader, less-targeted queries than like qualified demand showing up. So I can't say yet whether it's "more pages = more qualified impressions" or just "more pages = more noise." Haven't isolated for that specifically. Given clicks are still 0 everywhere, I think the honest answer is the site doesn't have enough proven search demand yet to know if page-level CRO would even matter - that's further down the list than getting any real qualified traffic in the door first.

      1. 1

        That distinction between more impressions and qualified demand is useful. If you’re open to it, what’s the best email to reach you on?

        1. 1

          Appreciate it, but I keep these conversations in the thread - happy to keep going here if you've got more questions.