Finding markets too small for VC's but plenty big enough for SMB's

Could a smaller market be an advantage?

Now I know everyone says "look for a big market" which might be reasonable advice if you're trying to get Venture Funding. But if you're not, it might make sense to go smaller - because you are much less likely to end up with VC funded competitors trying to compete and take your market away.

What do you think?