How Many Early Users Are Enough to Kickstart Building Your SaaS?

I've been gathering interest for my upcoming app (calmmind.ai) and am wondering, how many early users/subscribers are generally enough to confidently start building the actual product? Also, curious about how long it typically takes to build a SaaS before those on the early list start losing interest? Any insights or experiences shared would be super helpful!