17
104 Comments

I built two websites before talking to users. I think I see the problem now.

I've done the same thing twice now.

I get an idea.

AI makes it easy enough to build.

So I build the website first and start looking for the value afterwards.

The first was HeadSpaDirectory.com.

I thought a directory helping people discover head spas could be useful, so I quickly built the structure, added locations and listings, and started working on the site.

Only later did I start talking to actual spa owners.

Those conversations changed how I saw the project.

The more interesting problem wasn't simply:

"How do people find a head spa?"

It might be trust.

How do customers know whether a spa is actually trained in authentic Japanese head spa techniques?

That pushed me toward certification, practitioner background, and verified information things I hadn't understood when I built the first version.

Then I did almost exactly the same thing again.

I started AIStartupOfOne.com, a directory of AI-native one-person companies.

Again:

Idea → website → database → then conversations.

I've now started talking with founders.

And again, the conversations are changing what I think is valuable.

The founder profiles are useful.

But I'm becoming much more interested in the decisions behind them:

How did they decide what NOT to build?

What evidence was enough to keep going?

How did they get the first paying customer?

When does a solo founder stop building and start validating?

Here's the embarrassing part:

I already knew I was supposed to validate first.

My husband questioned the value and monetization of both ideas when I discussed them with him.

AI had even helped me map out the likely failure points of my first project.

None of this was new information.

And I still did it again.

That's what I'm trying to understand.

Maybe AI hasn't just made building easier.

It has made building feel like progress.

Talking to users is uncomfortable.

You send messages and get no reply.

People question your assumptions.

Sometimes you don't even know what question you should be asking.

Building is different.

You give AI an instruction.

Something happens.

A page appears.

A feature works.

You feel like you've moved forward.

Today I read a post here from a founder who shipped an AI job-hunting tool in three weeks but hasn't found paying users yet.

One line stood out:

"I can ship, but I don't naturally think about distribution. I built first and figured I'd tell people later."

I've basically done the same thing. Twice.

And it made me wonder if AI has created a strange new founder problem.

Building used to be a constraint.

Now one person can turn an assumption into a working product incredibly quickly.

That's amazing.

But maybe the dangerous sequence is becoming:

Idea → Build → Launch → Now let's find out if anyone actually needs it

instead of:

Problem → Conversations → Evidence → Build

The advice hasn't changed.

"Talk to users."

"Validate before building."

We've all heard it.

But maybe knowing the advice isn't the hard part anymore.

The hard part is resisting the temptation to build when building has become the easiest part.

I'm starting to think the scarce skill for solo founders is shifting from:

"Can I build this?"

to:

"Should I build this yet?"

I came across a line recently that stuck with me:

"Stories from your own business that nobody else has the receipts to tell."

Maybe this is one of mine.

Two projects. Same mistake.

I'm curious whether other founders are experiencing the same thing:

Has AI made you better at testing ideas — or mostly faster at turning assumptions into products?

on August 12, 2026
  1. 1

    The head spa insight — that the real problem was trust, not discovery — is the whole thing, and you found it faster than most people do.

    I run a jobs board in the AI space and hit the same shape of problem. "Where are the AI jobs" isn't actually the user's problem, because there are thousands. The problem is that most of what's listed is expired, duplicated, or a recruiter's ghost post. So the product became screening: roughly 37,000 postings run through a filter, a human approves what survives, and filled listings get deleted daily. The listing count was never the product. The deleting is.

    That generalises to your certification instinct — for a directory, aggregation is table stakes and verification is the moat. Anyone can scrape the spas. Knowing which ones have genuinely trained practitioners is work, which is exactly why it's defensible.

    On building-versus-validating: what partly resolved it for me was making the validation instrument the product's front door. Ours is a six-question quiz someone takes before seeing any results — what kind of work, what level, remote or not. It's a conversation with every visitor at a volume I'd never reach by DM, and the drop-off between questions tells me what people actually care about. Building it felt like building, which scratched the same itch, but every answer is evidence.

    So maybe the honest answer to your question is that AI made me faster at turning assumptions into products, and the fix wasn't more discipline — it was building things that generate evidence as a side effect.

    1. 1

      Making the validation instrument part of the product itself is really interesting. It gets around the build vs. validate split rather than choosing one side.

      The quiz makes a lot of sense once you have a steady flow of the right visitors. May I ask what did you do before you had that? How did you get enough of the right people in the door to start learning from their behavior?

  2. 1

    Since AI makes execution so fast, I've had to start forcing a simple rule on myself: no new features or UI changes until I can point to a specific user behavior or conversation that called for it. It's easy to confuse activity with progress. Appreciate you writing this down.

    1. 1

      Has that rule actually stopped you from building something you really wanted to add? If you have an example you can share, I'd love to hear it.

      1. 1

        Definitely, it stopped me from over-engineering a feature on AirChannel AI recently.
        I had drafted out this whole complex multi-folder workspace setup for managing WhatsApp and email threads because I assumed teams would want heavy custom organization. But forcing myself to wait for actual user feedback showed me people just wanted a single, zero-friction unified feed with internal notes so they could collaborate with team members and reply fast to queries.

        If I hadn’t forced that rule, I would’ve spent two weeks building workspace permissions that early users would've probably ignored anyway. It’s tough holding back when building is so easy with AI, but it really prevents building in a vacuum.

        1. 1

          That probably saved you a lot of unnecessary work. What made you trust that actual user feedback enough to change the plan? Was it the same thing coming from several users, or something you saw them actually doing?

  3. 1

    I think the interesting part is what happens between the click and the actual use of the product.

    Reach can tell you whether the message is getting attention, but activation tells you whether you're reaching the right people. I'd be looking closely at that step rather than optimizing for views alone.

    1. 1

      That's the tricky part for me. Clicks are easy to track, but the intent behind the click is much harder to get. We can see what people do next, but we're still interpreting why they did it.

      In your PPC work, how do you usually get closer to that intent?

  4. 1

    Have you started a third yet?

    1. 1

      Not yet. That's actually the test. I have a few ideas I could easily turn into a third site, but I'm trying not to build just because I can.

  5. 1

    This is such a common trap. I’ve done the same thing more than once — building first and only talking to people after the thing already existed.

    Curious what the main signal was that finally made you realize the problem. Was it the lack of replies, or something more specific people said?

    1. 1

      It wasn't really the lack of replies. It was realizing that I could keep improving the site and finding new reasons why the idea might work, while the actual evidence wasn't changing much.

      That's what made me uncomfortable. I was making progress, but I wasn't sure I was learning anything new. What was it for you?

  6. 1

    This hit close to home. Building feels like progress because its measurable and validation isn't. Maybe the real fix is a rule: no code until you've had three real conversations about the problem, not the solution.

    1. 1

      I like the idea of forcing a few problem conversations first. I'm just not sure conversations alone are enough.

      People don't always do what they say they want.

      I'd probably want to see some behavior too, even if it's small, before treating those conversations as validation.

  7. 1

    Yes — though it’s more reactive than systematic so far. The GEO failure I described taught me to ask: what has to be true one step before the thing I’m optimizing for?

    For the content pipeline: what has to be true for content to get cited? It has to be indexed first. I hadn’t asked that before building.

    The check I now try to run before scaling: can I point to evidence of the prerequisite working at small scale? One article indexed and appearing in an AI response before I build the pipeline to publish 18. One paying customer before I optimize the checkout flow. It sounds obvious but the tooling makes it easy to skip — you can go from idea to production in a day, and that speed is exactly the trap.

    Your framing of “what am I too inexperienced in this space to know I should check” is the harder version of the question. Pre-mortem covers known risks. The unknown unknowns only show up when you talk to someone who’s already failed that way — or fail yourself.

    1. 1

      That's probably the part no checklist can fully solve. You can test the prerequisites you know about, but experience is often what tells you which prerequisites exist in the first place.

      Talking to someone who's already failed in that space makes a lot of sense. That's a very different conversation from talking to potential users.

  8. 1

    I'm in the middle of this exact cycle right now. Built an AI tool, shipped it, now trying to find users. Your post made me pause and send 5 DMs to potential users before I add the next feature. Small step, but it's the step I was avoiding. Appreciate you sharing this.

    1. 1

      This is great to hear. Sending those 5 DMs before adding another feature might tell you more than the feature itself.

      Let me know what you hear back, if you are open to sharing

  9. 1

    "Building feels like progress" is such a spot-on realization. With AI, creating a clean UI or spinning up a full app happens so fast that it gives you an instant dopamine rush before you even know if anyone needs it.
    ​As someone building a UI tool (NexoreUI), I see this trap every day — it's so tempting to keep polishing components and adding features because code gives immediate, predictable feedback, while talking to users brings friction and uncertainty.
    ​Asking "Should I build this yet?" instead of "Can I build this?" is definitely the ultimate founder skill right now. Great post!

    1. 1

      With a UI library, I imagine another challenge is figuring out whose feedback actually matters. Talking to users helps, but feedback from someone who isn't really your target user could also send you in the wrong direction.

      How do you decide which feedback to act on with NexoreUI?

  10. 1

    The behavior you describe makes sense because building gives immediate, legible feedback while validation gives delayed and ambiguous feedback.

    One practice that helped us over a longer product cycle was to treat every feature request as a hypothesis with two separate columns: evidence and commitment. A user saying “I need X” is evidence, but it is not yet a commitment to build X. We looked for the repeated job behind the request, then tested the cheapest reversible version first—copy, a manual workflow, a spreadsheet, or a small UI change.

    The useful question became: “What would we have to observe to change our mind?” If the answer is only “people say they like the idea,” the test is too weak. Stronger signals are people sharing a real workflow, giving access to ugly examples, returning for a second session, or accepting a manual version before automation exists.

    AI makes the prototype cheaper, but it also makes throwing it away emotionally harder because the prototype looks finished. Keeping the first test deliberately small and temporary helps preserve the option to learn instead of defend what was built.

    1. 1

      The evidence vs commitment distinction is really helpful. A feature request can feel much stronger than it actually is, especially when building the feature is now so cheap.

      The examples you gave make the difference much clearer to me. Someone coming back for a second session or accepting a manual version says a lot more than 'I’d use this.'

      One thing in your last paragraph really stood out to me: 'learn instead of defend what was built.'

      Have you actually seen the team react differently when the first version is deliberately rough? Like being more willing to drop or change it when the evidence isn't there?

    1. 1

      Thanks for your sharing, I haven't read The Mom Test yet, but it sounds very relevant to what I've been wrestling with here. I'll check it out.

  11. 1

    The "measurement problem" you're naming is the real trap. You can measure building: features shipped, lines of code, velocity. But you can't measure validation through code - only through uncomfortable conversations with humans. So founders rationally optimize for the thing they can measure. AI didn't create this trap, but it weaponized it by compressing the cost of building to near-zero. When a website takes three weeks, that's an expensive validation failure. When it takes three hours, founders feel entitled to ship-first-ask-later because the "sunk cost fallacy" is actually a sunk cost now. The founders who win aren't the ones who ship fastest - they're the ones uncomfortable enough to ask questions before they've fallen in love with their solution.

    1. 1

      The measurement asymmetry makes a lot of sense to me. Building gives you numbers almost automatically, while learning takes more work to make visible.

      One thing I'm starting to question though is whether validation has to come mainly from conversations. A few people here have shared examples where search behavior, actual usage, or accepting a manual version told them more than what users said. I'm starting to think the harder part may be deciding what behavior counts as strong enough evidence.

  12. 1

    I think I'm experiencing the same thing. I'm using ai For basically anything: From Building my website to Automate Functions of the website itself. I also validate using Ai, I ask it 'Is there demand For X?' and ai answer, maybe by doing web research, but I never check directly. Building with ai is definetly faster, but the hard part is finding people who actually want to use your product.

    1. 1

      I relate to that last part. AI can give you a pretty convincing answer about demand, but finding people who actually want to use the product is a different story.

      What have you tried so far to find those people, and what happened?

  13. 1

    "Building feels like progress" hits the spot. Prompting AI gives you that instant dopamine fix—a shiny new UI, a working database—while cold DMing 20 strangers feels like pulling teeth because nobody likes rejection. AI basically made building so effortless that it became our favorite way to procrastinate on actual validation. Super honest reflection, thanks for sharing this.

    1. 1

      The difference in feedback is huge. AI gives you something back immediately, while 20 cold DMs might give you mostly silence.

      With NomadOS, has anything you heard from freelancers actually made you drop or change something you originally wanted to build?

  14. 1

    This is one of those lessons that sounds obvious in hindsight: building faster doesn't matter if you're building the wrong thing. Talking to users early can save weeks of development.”

    1. 1

      Exactly. Building faster doesn't help much if the direction is wrong.

  15. 1

    i think your API keys are leaked!update your front end code

    1. 1

      Ohnooo Thanks for flagging this. Which site and where did you notice it?

  16. 1

    This really resonates. AI has made building so easy that it can feel like validation when it’s really just execution.

    I like one simple question for this: What uncertainty am I reducing right now?

    Sometimes 5 user conversations move the business forward more than 5 new features. Maybe the new founder skill isn’t shipping faster, but knowing what needs to be learned before shipping.

    1. 1

      'What uncertainty am I reducing right now?' is such a useful question. I’ve realized I can have a very productive-looking day and still reduce almost no uncertainty.

      Maybe that’s the distinction I was missing: not 'what did I get done today?' but 'what did I learn today that changes what I do next?'

      1. 1

        Exactly. “Productive” and “informative” aren’t always the same thing. A good day early on might be one where you invalidate an assumption before spending a week building it.

        1. 1

          Yeah learning what not to build counts too.

  17. 1

    This resonates hard. The painful irony we see running forgex.systems is that founders who build too early often spend their tech budget on the wrong thing, then come to us to "fix" what could have been avoided.

    The founders who move fastest through us are the ones who've had exactly 10-20 conversations that revealed a specific, recurring pain before they touch a spec. Having a waitlist of 50+ and resolve their pain points.

    Your reframe from "can I build this?" to "should I build this yet?" is the exact question I wish more founders brought to us on day one.

    1. 1

      This is especially interesting coming from the team founders eventually hire to build. By your own standard, I suspect neither of my projects is at the point where I should be handing someone a spec yet.

      The 10–20 conversations + 50-person waitlist caught my attention. From what you've seen, is it really those numbers that matter, or is there something specific you hear or see in those founders that tells you, 'now this is ready to build'?

      I'm trying to understand what 'enough evidence' looks like in practice without just replacing 'build first' with another arbitrary target.

  18. 1

    AI made me 10x faster at turning assumptions into products. That turned out to be the problem.

    Two months ago I built an automated content pipeline — an agent that researched, wrote, and published GEO-optimized articles daily. Two weeks, 18 articles. Every step ran cleanly. Revenue: $0. Citations: zero. Indexed pages: zero.

    The diagnosis took another week: Google hadn't crawled a single post. I'd been optimizing the production step — the one AI made effortless — without ever verifying the prerequisite. The chain is: indexed → AI crawlers discover → AI cites. I hadn't cleared the first gate.

    Your phrase "I built first and figured I'd tell people later" maps exactly. I built first and figured I'd verify distribution later. The automation made it easy to rationalize skipping that check — "I'll just launch and see." At manual pace, 18 articles takes months and you notice sooner when nothing's happening. At agent pace, two weeks passes before you realize the clock never started.

    So: AI didn't make me better at testing ideas. It made the consequence of not testing arrive faster, and in larger batches.

    1. 1

      I relate to this from another angle too. Sometimes the problem isn't that I skipped a prerequisite, it's that, as a newcomer to a space, I didn't even know the prerequisite existed.

      For example, when I first started building websites, I knew very little about things like Search Console, indexing, or what data I should be tracking from day one. The same applies to legal or platform risks: AI can help me execute what I ask for, but it doesn't always surface the important questions I didn't know to ask.

      Your example makes me think there may need to be a step before 'build vs. validate': what has to be true for this to work, and what am I too inexperienced in this space to know I should check?

      Do you do any kind of prerequisite or pre-mortem check now before you automate or scale something?

  19. 1

    The repeated mistake suggests the real constraint is no longer building speed; it is creating a forcing function for evidence. I’d make the rule behavioral rather than aspirational: before adding the next feature, collect five examples of the painful moment in the user’s own words and one costly action they already take to solve it. For the spa directory, certification became meaningful only when owners raised it unprompted—that is much stronger than a trend or a signup. A small build can still be useful if it is designed as a question: a profile mockup, concierge listing, or paid verification offer that can clearly fail. What evidence would make you stop either project now, rather than simply reposition it again?

    1. 1

      This is probably the hardest question in the thread for me: what evidence would actually make me stop, rather than just find a new positioning?

      I don't think I've defined that clearly enough for either project. I've been much better at asking 'is there still a reason to continue?' than defining in advance what would count as evidence to stop.

      I’ve always believed in starting with an MVP, getting something small working, and expanding from there. But your phrase 'designed as a question' adds something I hadn’t framed clearly before: the MVP shouldn’t just be small, it should be built to test a specific assumption, with a result that could actually prove me wrong.

      For the spa directory, the next thing I need to test is whether certification actually translates into something customers perceive and act on, more trust, preference, or willingness to book. I'm thinking about it a bit like a patent: the credential itself has little value to the end user unless it creates a better or more trustworthy experience.

      For AI Startup of One, I'm still figuring out the equivalent signal. The founder conversations are clearly producing insights, but I haven't yet defined what behavior would prove those insights are valuable enough to become a product.

      I need to think more seriously about the stop criteria for both. Thanks for pushing the question in the other direction.

      Also, I noticed you're running multiple small products that are already generating revenue. Given what you said about designing a build as a question, I'm curious what did the earliest version of that product look like, and what was the first piece of evidence that made you decide it was worth continuing?

  20. 1

    Spa owners bringing up certification unprompted is the signal, and you only got it by talking. That argument is usually already running in public, customers asking how to tell whether a place is genuinely trained, long before anyone builds a directory. Viewfy's thread scout reads that phrasing before a site exists. Both directories may still work out, the order just costs you a rebuild each time.

    1. 1

      That distinction between a signal appearing unprompted and something I reasoned my way into is really useful.

      Your point about ‘the order just costs you a rebuild each time’ also made something click for me. In product management, I learned to start from the problem space and then connect it to possible solutions, not build a solution first and work backwards to find a problem for it.

      Ironically, AI made the solution side so easy to build that I did exactly that twice.

      The first builds weren't necessarily wasted, but I paid for the learning in rework and repositioning that I might have gotten much earlier through conversations.

      And certification is a good example: I had thought about differentiation before building the directory, but it only became meaningful evidence when a spa owner brought it up unprompted.

      I’m adding ‘unprompted signals’ to the way I think about validation.

      Thanks for this.

  21. 1

    The practical test I use now is: can I describe the painful moment before describing the product? If I can only pitch the thing I built, I am probably still validating my imagination, not the customer problem.

    1. 1

      This makes me rethink what I actually did.

      With both projects, I did have a rationale and thought about differentiation before building. But neither really started from a painful moment I had observed in the target user.

      One came from seeing a growing search trend (and my own interest in the service, even though I’m not in the US market I was targeting).

      The other came from a space I’m personally fascinated by and want to be part of.

      So maybe the test isn’t just ‘do I have a reason to build this?’ but ‘can I describe a painful moment the target user is already experiencing, without referring to my solution?’

      That distinction is useful. Thanks for putting it this way.

  22. 1

    As someone who spends a lot of time building web applications and digital utility tools, this hits incredibly close to home! AI has absolutely made me faster at turning assumptions into products, and it's a constant battle to pause and have those uncomfortable conversations first. Your realization about the scarce skill shifting from 'Can I build this?' to 'Should I build this yet?' is a perfect summary of the current landscape. Thank you for the honest reflection!

    1. 1

      That 'constant battle to pause' resonates with me. What I’m realizing is that I actually was trying to validate, just not always with the strongest kind of evidence.

      I kept stress-testing both ideas with AI, asking whether they were worth continuing, and discussing them with my husband, who often challenged the value and monetization from an outsider’s perspective.

      Those conversations helped me reason about the ideas, but they weren’t the same as hearing an unprompted problem from the people I actually wanted to serve.

      So maybe another question I need to ask myself is not just 'Have I validated this?' but 'Who or what is the evidence coming from?'

      Curious if you’ve found a practical rule for deciding when you have enough real world evidence to start building.

  23. 1

    The part about building feeling like progress is the real trap. I’ve started separating validation into four questions before touching the product: Is the problem frequent enough, are people already spending money or effort on it, can I name a reachable first customer segment, and is there a believable path to the first 10 customers? If one of those is still vague, the next step should generate evidence rather than features. A landing page can help, but I’d treat signups as weak evidence unless people also reply, book a call, pre-order, or take another costly action. What did the spa owners say that changed your direction most?

    1. 1

      That's a good question, and it actually makes me correct something in how I've been describing the spa example.

      The certification insight didn't come from a spa owner bringing it up to me directly. I first connected with a Japanese head spa owner on Instagram to ask permission to use her photos. While researching her website and public posts, I noticed how strongly her Japanese training and teacher lineage were part of her positioning.
      That led me to the hypothesis that authenticity, training and certification might matter more than I originally thought.

      But by the framework we're discussing here, that's still a signal, not strong validation. I haven't yet shown that customers actually care about those credentials enough to change where they book.

      So your question helps clarify my next step: instead of building more certification features into the directory, I need to find out whether customers actually use authenticity/training as a decision criterion.

      I also like your point that when one of those four questions is vague, the next step should generate evidence rather than features.

  24. 1

    There’s a version of this that applies past the building stage too — a lot of founders (and honestly a lot of buyers doing diligence) skip straight to the numbers before really talking to the people behind them. What clicked for you once you started those conversations — was it a specific pattern in what people said, or more just realizing what you’d been assuming?

    1. 1

      With AI Startup of One, I started with a broader vision: document how individuals are building companies with AI, and eventually build an intelligence layer around this new kind of company. The database was my first product, a structured way to capture who these founders are, what they're building, how they use AI, their business models, traction, etc.

      Once I started talking with founders, though, I found myself much more interested in what the database couldn't easily capture: the decisions behind those facts, why they chose one direction over another, what evidence made them continue, what they stopped doing, and how they knew when something was or wasn't working.

      I wouldn't call that a validated pattern yet. The conversations are showing me that documenting what founders build and understanding how founders decide may be two different layers of the same mission.

      Even this thread is reinforcing that for me, the data points tell me what founders are building, but the most useful responses are helping me understand the rules and evidence behind their decisions.

  25. 1

    The trap of modern development is exactly how you described it: AI has lowered the barrier to shipping so much that the 'cost of being wrong' now feels like zero. When you can spin up a directory or a landing page in an afternoon, you lose the friction that usually forces you to validate whether the pain point is real before you commit to the code. You're not just building; you're essentially gambling that the problem you imagined has a market-ready audience behind it. Recognizing that 'ease of building' is a different metric than 'value creation' is a huge shift in maturity for a founder. Next time you have an idea, try a landing page with a waitlist that forces you to articulate the specific value proposition for a specific customer type. If you can't get three people to sign up based on a description, you've saved yourself the work of building the actual directory, which is the best kind of 'failure' you can have.

    1. 1

      I agree that a landing page can be a useful first test. The part I'm rethinking is whether a few signups would be strong enough evidence for me.

      This actually reminds me of something from a recent social marketing class in my MBA. One of the ideas was 'quality over quantity' that follower count is easy to see and measure, while a lot of the real value in social marketing comes from things that are harder to see: listening to customers, conversations, complaints, and identifying real intent.

      I think validation has a similar measurement problem. Signups are easy to count, just like followers. But a meaningful reply, someone spending 30 minutes explaining their problem, a referral, a booking, or willingness to pay tells me much more.

      So for my next idea, I think I'd change the question from 'can I get three signups?' to 'can I get three people to care enough to take a meaningful action?'

  26. 1

    Funny timing, I left a comment on that same job hunting thread, so your quote comes full circle.

    Honest answer to your closing question, AI made me faster at both, and the direction it points depends entirely on what I aim it at. I haven't done the interview users step either. What saved me was an accident of format, my product is a personal finance site whose free half is a pile of small single purpose calculators, and each one answers a question people type into Google. So every page doubles as a validation instrument whether I want it to or not. Search demand is a user interview that never cancels on you. It has worse follow-up questions but a much bigger sample size.

    The paid half was still a bet built on assumptions, same as you. The difference is the bet sits on top of pages where demand was beginning to become measurable, so the worst case was the paid thing flops on a free site people still use rather than nobody wanted any of it to begin with.

    Where AI actually changed my behavior was this week, and it's the opposite of the trap you're describing. I pulled all of my Search Console data and had it paired against my pages, which queries earn impressions on a page that answers a different question. That analysis picked my next build for me. There was a cluster of a hundred plus impressions for a calculator I don't have, landing on a neighboring one I do. So the next thing I ship was chosen by evidence, and building it is the validation step.

    Maybe that's the reframe, the problem was never that building is cheap. It's that building used to be so expensive we needed certainty first. Now it's cheap enough that a page can BE the question you ask the market. But only if the thing you build is small enough to be a question.

    Your "should I build this yet" framing is good. I've asked myself what's the smallest thing I can build that generates evidence as economically as possible instead of consuming my certainty.

    1. 1

      Funny that we both ended up in the JobHunting thread and then here :)

      Your Search Console example especially resonated with me. I’m starting to see early impressions on AI Startup of One too, and I’ve mostly been treating them as SEO signals. Your example makes me think about them differently as behavioral evidence that could help decide what’s worth testing next.

      I also agree that we don’t need certainty before acting. Sometimes putting a small concept into the real market is the cheapest way to learn what to do next. AI makes that incredibly efficient.

      The tension I’m still thinking through is direction. If building is cheap enough to become the question, what evidence do we need before deciding which question is worth building?

      Maybe the distinction is: I don’t need evidence that the direction is right. I need enough evidence that it’s worth testing then build the smallest thing that can prove me wrong.

      Your calculator example seems to fit that well. The search behavior didn’t prove the next calculator would work, but it gave you a reason to test that direction. That feels different from building first and then looking for evidence that the thing you built should exist.

      I really like your framing of asking, 'what’s the smallest thing I can build that generates evidence as economically as possible?' I think that’s closer to how I want to approach the next build.

  27. 1

    The "building feels like progress" diagnosis is sharp. AI collapsed the cost of a polished site so hard that the dopamine hit now arrives before any customer signal does. What helped me break that loop is treating the first conversations as the product: five real replies from spa owners or founders beat another week of directory features. Ship a landing page only if it is a question you are asking people, not a product you are defending.

    1. 1

      'Treating the first conversations as the product' really resonates with me.

      I haven't had five deep conversations with spa owners yet, but I have started getting different levels of evidence: some owners replied to confirm or correct the information I published, and one gave me their booking link to connect the directory directly to their booking flow.

      That distinction is becoming important to me. A reply, a correction, a booking link, and a paying customer aren't equal signals but each can remove a different kind of uncertainty.

      And I agree with your broader point: another week of adding directory features probably tells me less right now than a few more meaningful interactions with the people it's supposed to serve.

      This thread is making me think about early progress differently: not how much did I ship, but how much uncertainty did I remove?

  28. 1

    I did the reverse of your experiment after reading this: opened both sites cold, as a stranger, to see whether the pages have caught up with what the conversations taught you.

    HeadSpaDirectory mostly has. "Find a Real Japanese Head Spa" plus "a trust filter, not a generic ranking" is the certification insight, right in the hero. One gap: the Signal Score's visible checks (dedicated page, online booking, price listed, treatment steps) verify a spa's website hygiene, not the thing you said actually matters - training and practitioner background. The page promises the new value, then proves it with the old signals.

    AIStartupOfOne still sells the earlier hypothesis: the hero promises founder stories and profiles, while your post says the value moved to the decisions behind them - what NOT to build, what evidence was enough to keep going. That page hasn't caught up with you yet.

    Maybe that's the practical version of "validate first" for people who are going to build anyway: the landing page is a statement of your current hypothesis. Every time a conversation moves the hypothesis and the page stays put, visitors are testing yesterday's version of your idea.

    1. 1

      This is a really useful way to look at it. I hadn't thought about the landing page as a snapshot of the hypothesis I'm currently testing.

      Your point about HeadSpaDirectory is especially sharp. The hero has started moving toward authenticity and trust, but you're right that the visible signals are still mostly things like booking, pricing and treatment information. Those tell me whether a spa is transparent and easy to evaluate, but they don't necessarily prove the thing I'm now questioning: whether training, certification and practitioner background are actually the trust signals customers care about.

      And I think you're right about AI Startup of One too. My conversations have moved faster than the site. I started with founder profiles as the first product, but I'm increasingly interested in the decisions behind the profiles what founders chose not to build, what evidence changed their direction, and what made them keep going.

      The part I want to be careful about now is not immediately rebuilding both sites around the latest insight. That might be me repeating the same mistake in a different form.

      Maybe the next step is to treat these gaps as hypotheses to validate before I update the pages again.

      Really appreciate you opening both sites cold. This is exactly the kind of feedback I’ve been missing someone coming in without all the reasoning in my head and showing me where the page no longer matches the hypothesis I think I’m testing.

  29. 1

    Building is just a comfortable way to procrastinate on doing actual customer research

    1. 1

      Comfortable is the key word. Building gives you instant proof of progress, customer research gives you uncomfortable uncertainty.

      I’m learning to ask myself: did this build reduce uncertainty, or just make me feel productive?

  30. 1

    Validating before coding is a hard lesson almost every founder learns the hard way. If you ever decide to offload those initial builds, don't let the code go to waste—there's usually someone looking for starter projects. I built Digimarket with an AI valuation tool for this exact reason.

    1. 1

      I’ve actually thought about this too. If I decide not to keep operating one of these projects, I’d rather sell it than simply abandon it.

      Sometimes the domain or idea may still have value, there might just be someone better positioned to operate it and realize that value.

      But I’m also trying not to let that become an excuse for building before validating :)

  31. 1

    Validating before coding is a hard lesson almost every founder learns the hard way. If you ever decide to offload those initial builds, don't let the code go to waste—there's usually someone looking for starter projects. I built Digimarket with an AI valuation tool for this exact reason.

  32. 1

    The shift from "can I build this" to "should I build this yet" is the whole post in one line for me. AI didnt create this problem, it just removed the excuse of not having time to build first and ask questions later.

    1. 1

      Exactly. AI didn’t create the build-first instinct it just removed a lot of the friction that used to slow us down. Maybe that friction was doing more useful work than I realized

  33. 1

    The "building feels like progress" framing is exactly right and I don't think it gets talked about enough. Building gives you the dopamine of forward motion without the discomfort of being told your assumption is wrong. Talking to users gives you the opposite: slow, uncertain, occasionally demoralizing feedback that sometimes saves you six months.

    I went through a version of this for a solid year. Built features, polished things, kept asking "what's missing?" instead of "who actually wants this?" The features were fine. That wasn't the problem. The problem was I was answering engineering questions before I'd answered customer questions.

    The thing that shifted it: I stopped asking "do you like this?" in conversations and started asking "when did you last have this exact problem?" That question either surfaces a real recent pain or reveals someone being politely interested in an idea. The gap between those two responses is enormous.

    To answer your question directly: AI made me faster at turning assumptions into products. I became better at testing ideas the hard way — by running out of things to build and being forced to talk to people.

    1. 1

      The dopamine point is very real for me. Sometimes I start doubting a project, talk it through with AI, and an hour later I have a new angle or a better-looking version of the site. It immediately feels like progress again.

      But that feeling doesn't last, because eventually I still have to come back to the real world and ask whether anyone actually cares.

      I really like your distinction between 'do you like this?' and 'when did you last have this exact problem?' I think I've been asking for too many opinions when what I need is evidence of behavior.

      I'm stealing that question for my next conversations: 'When did you last have this problem, and what did you do about it?'

  34. 1

    Building feels like progress” is such a good way to frame it. AI has made execution faster, but it hasn’t made validation any easier. The real challenge now may be knowing what evidence is enough before building.

    1. 1

      This is the question I'm still struggling with: what counts as enough evidence?

      I don't think the goal is certainty before building, you could research forever and still be wrong. I'm starting to think it’s more about defining an evidence threshold before you get emotionally attached to the build.

      Given your web dev background, I'm curious how you think about that line when is there enough evidence to start building rather than keep validating?

  35. 1

    One thing I might test in the second project is to treat the profile as the interview invitation, not the product. Pick 10 founders, show them a deliberately incomplete profile, then ask what decision they wish they had documented at the time. If the same missing decision keeps coming back, you have a clearer product direction than another round of adding profiles. It also gives each week of validation a visible output.

    1. 1

      This is very actionable. Honestly, I don't have 10 founders I can reliably get this kind of feedback from yet, but I do have one founder I've had an ongoing conversation with.

      Instead of just asking whether his profile is accurate, I'm going to try your question: 'Looking back, what important decision in this journey is missing from this profile?'

      Even with one founder, I can at least test whether that question surfaces something more valuable than another round of profile edits. If it does, I'll keep using it as I build more founder relationships.

  36. 1

    Recently started my first project. I have done things in the most outlandish order. But, one thing I have noticed is when I am using AI to code, I do spend a lot of time doing what feels like busy work. Nothing is being solved, but I am running different lines of code or prompts to try to push fusher. It has made it easier to test ideas, but it takes away part of the due diligence aspect. We have the ability to throw out different websites/ideas that don't take that much to create. Vetting these ideas is not as necessary

    1. 1

      That's a really interesting distinction. I recognize the 'busy work' feeling too AI makes it so easy to keep changing code, prompts, or the product that activity itself can start to feel like progress.

      I'm starting to think cheaper building doesn't necessarily make vetting less important, but it can change how we vet. A tiny build can be part of the due diligence if it's testing something specific in the real world.

      The question I'm trying to ask myself now is: what uncertainty did this build actually remove?

      If the answer is 'none, but the site is better now,' that's probably when I'm just staying busy.

  37. 1

    The “idea → build → launch → learn” loop can seem productive because something is tangible at each step. The issue is that all of those outputs do not necessarily decrease uncertainty.

    I think it's helpful to differentiate building progress from learning progress. A second site can be a lot of trouble and little to no new learning about whether the problem matters.

    The change of mindset from considering the question: Should I build this? to: What do I need to learn before building this? is a subtle one but can make all the difference. The number of weeks that can be wasted on one or two meetings is quite surprising.

    The question regarding the rationale behind the founders building is particularly significant. Sometimes it's not the problem of execution in itself—it's the problem of getting used to the idea that it should change.

    1. 2

      The distinction between building progress and learning progress really resonates with me.

      I think I've sometimes mistaken one for the other especially when AI makes it so easy to keep iterating and feel momentum again.

      Your point about getting used to an idea also made me curious about MORPHOICES itself.

      Since you're building it now, have you set any signals that would make you rethink the direction or even stop rather than keep iterating?

  38. 1

    AI made building and validating both faster, so the sequence you pick matters more than ever. The founders I back who win use AI for the uncomfortable half first, drafting outreach, summarizing interview notes, pressure testing assumptions, before a single page exists. Building was never the scarce skill, tolerating the discomfort of being questioned is.

    1. 1

      That's a useful distinction. I do use AI for outreach, synthesizing feedback. But your last point made me realize something: AI can help me prepare for validation, but it can't replace the discomfort of having a real person challenge the assumption.

      And when I don't have enough of those external voices, it's very easy to keep reasoning with AI and find another reason to continue.

      Given your experience backing early-stage founders, I'd be really curious how you'd look at the two cases I shared here. If these came across your desk, what evidence would you want to see next before believing either one was worth continuing or that I was the right person to keep building it?

  39. 1

    I recognize this pattern in myself too. Building is the comfortable part because there is always a clear next step. You add a feature, fix a bug, improve the UI, and at the end of the day you can see what you accomplished.

    Talking to people is much less predictable. You can spend hours reaching out and get nothing back, or get feedback that makes you question something you already spent weeks building.

    I think AI makes that difference even bigger. It gives us the ability to build faster, but it doesn't make people care faster.

    I'm trying to remind myself that another completed feature isn't always more progress than one useful conversation. That's much easier to understand than to actually practice.

    1. 1

      'AI lets us build faster, but it doesn't make people care faster' really resonates with me.

      I wonder if we're already seeing another side of this too. At first, AI-generated work felt impressive simply because of what AI could do. Now that it's everywhere, people seem much quicker to recognize the 'AI feel' and sometimes value the human, imperfect parts even more.

      I noticed you've launched two products yourself. After launching something, what signals tell you it's worth continuing to invest in it rather than moving on to the next build?

  40. 1

    Talking to users early is the fix, but the hard part is what to ask. I ran the same loop for 3 months on my own product — the questions that changed my roadmap weren't "would you use this?" (everyone says yes) but "what did you do the last time this problem came up?". Past behavior beat stated opinions every time. Your founder interviews are already pointing there: the decisions are the real data.

    1. 1

      This really resonates. One thing I learned in product work is that users are often much better at describing the outcome they want than the solution itself. Someone can tell you 'I need to get there faster,' but they'll rarely tell you to invent an airplane.

      That's why your 'what did you do the last time this problem came up?' question feels so useful, it keeps us focused on the real problem and behavior instead of asking users to validate the solution we've already imagined.

      You mentioned those answers changed your roadmap. Was there one specific answer or behavior that made you change something you had already decided to build?

  41. 1

    The trap isn't that you didn't know you should validate. It's that "validation" has no measurement system. Every other phase has one: building has a finished feature (it works), shipping has a date (launch happened), scaling has metrics. But validation? "Talk to users" doesn't tell you when you're allowed to stop. So your brain keeps asking for one more conversation. You showed this perfectly: both projects got sharper through conversations, but there was never a point where the conversations said "you have permission to build." If I had to guess at what changes, it's not your discipline. It's defining "validation is complete" with the same specificity you'd use for "the feature works"—a number (10 conversations) and a decision (does the pattern hold) before you start, not after. Right now you're measuring effort (we talked to people). What if you measured readiness instead (we found the evidence we needed)?

    1. 1

      This hits something I've been struggling with. I actually have set some SMART-style milestones for both projects, but I've found that defining a measurable milestone is much easier than making it decision-useful.

      For example, 'talk to 10 people' gives me a finish line, but it still doesn't tell me what I need to observe in those conversations to justify continuing, changing direction, or stopping.

      So your distinction between effort and readiness really clicks. Since you've been through this as a co-founder yourself, how do you define 'the pattern holds' in practice? What turns a milestone into evidence you would actually commit resources against?

  42. 1

    The bit I'd add: "validate first" loses to "build first" not because people forget the advice, but because validation has no definition of done.

    Building has a visible finish line. The page renders, the feature works, you can point at it. Validation doesn't. There is always one more conversation you could have, and no moment where anyone tells you you're allowed to stop. Given a task with a finish line and a task without one, the brain picks the first every time and calls it progress. That isn't a discipline failure, it's a missing shape.

    So the thing that actually worked for me wasn't more willpower, it was giving validation the same shape building has: a number and a date, written down before starting, with the decision pre-committed in both directions.

    Mine, in the open, since you asked for receipts. Landing page for a QA service, fixed price per sprint, and a kill condition I wrote before I built anything: 3 paying customers or 25 signups within 14 days, or I change the offer exactly once and then park it. Day two, currently zero of both. That is genuinely uncomfortable to type, which is rather the point. Writing the number was easy. What it actually costs is that in twelve days I won't be able to talk myself into "it just needs a bit more polish".

    One thing worth saying about your own two though: both projects got sharper the moment you talked to people, so the conversations were working fine. What was missing wasn't the talking, it was the point at which the talking was allowed to end and a decision got made. And a directory of one-person AI companies where you interview founders about how they decided what not to build is a fairly good description of validating your own question in public. I don't think that's the same mistake a third time.

    1. 1

      The 'change the offer exactly once and then park it' part really stood out to me.

      I've set milestones before, but I also have this competing voice in my head saying: meaningful things take time. Not everything compounds immediately, and stopping too early can look a lot like being disciplined when you're actually just being impatient.

      That's where I still struggle, distinguishing genuine long-term persistence from moving the goalposts because I don't want to let an idea go.

      Your last point about the AI founder directory also gave me something to think about. Maybe the difference isn't that I've suddenly learned to 'validate first,' but that the research itself is becoming part of how I test the question.

      How did you choose 3 paying customers / 25 signups / 14 days? And how do you know 14 days is enough time to trust the signal rather than simply too early?

  43. 1

    The “building feels like progress” point is probably the most interesting part here. AI removes so much friction from execution that it becomes very easy to mistake activity for evidence.

    I’m curious whether your conversations changed the direction of either project enough that you’d now build something substantially different from the original version.

    1. 1

      Yes, but in slightly different ways.

      For HeadSpaDirectory, I started with a fairly generic directory / information-transparency idea. The conversations and research have pushed me toward a much narrower question around authenticity, Japanese training, certification, and trust. That's substantially different from where I started, but I still don't know whether those signals actually change customer or spa owner behavior, so I'm trying not to rebuild around the new hypothesis yet.

      For AI Startup of One, the shift is more interesting. I started by documenting what solo founders are building with AI. The conversations keep pulling me toward why they made certain decisions, what evidence made them continue, pivot, stop, or not build something at all.

      The difference this time is that I'm resisting the urge to immediately turn that insight into another product. I want to see whether the pattern keeps showing up first.

      1. 1

        That second shift is especially interesting — noticing a pattern without immediately turning it into a product. I’d be interested in hearing where that leads as more conversations accumulate. What’s the best email to reach you at?

        1. 1

          Haha, I think we’re already talking over email. I just replied to your thread earlier today.

  44. 1

    I think the “building feels like progress” part is the real trap. AI has made the cost of turning an assumption into something working so low that it can actually make validation feel slower than building.

    The harder question now might not be “can I build this?” but “what evidence do I need before I earn the right to build it?”

    I’m curious whether you think the answer is simply stronger validation habits, or whether AI could eventually help founders stay in the evidence-gathering phase without immediately jumping into implementation.

    1. 1

      I think AI could help us stay in the evidence-gathering phase, but only if we deliberately design it to push us back into the real world when evidence is missing.

      I've found AI incredibly useful when entering an unfamiliar space, it can help you understand the landscape much faster. But that's also where I see a risk: without enough domain experience, it's hard to judge which information matters, which assumptions are plausible but weak, and which signals actually deserve a decision.

      AI can make a possible future sound very coherent, sometimes so coherent that you start feeling confident before the real world has given you a reason to be.

      So maybe the ideal workflow isn't just an AI that remembers project context, but one that also remembers: what do we actually know, what are we only assuming, and what evidence still has to come from outside this conversation?

      1. 1

        That’s exactly the distinction I’m starting to care about: AI can organize and accelerate evidence gathering, but it shouldn’t be able to manufacture confidence from incomplete evidence.

        Maybe the useful role is making assumptions visible — and reminding us which ones still need a real-world answer.

        1. 1

          Yes, 'making assumptions visible' is a great way to put it.

          Since you’re building Xeyria around persistent project context, have you thought about preserving not just what a user decided, but why they decided it and what evidence that decision was based on?

          I’m starting to think that distinction between decision history and evidence history could matter a lot.

          1. 1

            That last instinct seems right to me, and there's a cheap way to honor it: rewrite the words, not the product. A hero line stating the new hypothesis costs an afternoon and is fully reversible - if "verified training, not just a tidy website" resonates, replies and clicks tell you before you build any verification machinery. The trap you're describing is rebuilding the system around each new insight; the page is the one place where changing your statement of belief is nearly free. Features are commitments. Copy is a question.

            1. 1

              'Features are commitments. Copy is a question.' That's a useful way to think about it.

              1. 1

                That last sentence is the one that stays. A checklist only covers the prerequisites you already knew existed — experience is what tells you the list was incomplete.

                The rsync incident I mentioned in the GEO post is the same pattern: I had a deployment checklist. It didn’t include “verify --delete won’t touch state outside the source tree” because I didn’t know that was a prerequisite until I’d already lost the files. The checklist was correct for what I knew. That’s the gap talking to someone who’s already failed in the same space actually closes.

                1. 1

                  That distinction matters. The checklist wasn't wrong, it just couldn't include a failure mode you didn't know existed yet.

Trending on Indie Hackers
What 100B+ Claude tokens actually look like inside a tiny company User Avatar 32 comments 4 months to go. Chrome extension live. Web search integrated. 4 users. $0 revenue. Still here. User Avatar 26 comments Solo → Pre-Seed: The Tool Stack Decision That Will Either Save or Sink Your First 18 Months User Avatar 24 comments Two-way is not the same as symmetric User Avatar 20 comments Show IH: Apollodorus Video - browser-based video editor that runs locally User Avatar 9 comments Show IH:GSL Runtime: Moving Beyond .vrp Input User Avatar 7 comments