Looking for passionate developer to help build website crawler
I've found a great opportunity from a marketing prospective to for a website crawler i.e. a DeepCrawl alternative. Though I know the version we'd make/start with would be an MVP equivalent.
Ultimately if we were able to gain traction we'd be able to scale up into a paid product. I already pay as an SEO agency ~£300 per month on these services currently and this is only going to increase with time.
I personally come from a marketing background and would be able to handle this side of the project. I currently run a digital marketing agency and have a team of 7 staff.
I was more looking to pair up with someone to help bring this idea to life and leverage this particular marketing opportunity. If you are interested drop me an email to speak further info at elliottdavidson dot com.
Are you talking about building a crawl engine? A specific crawler? One of the common internet marketing products like links, ranks in SERPs ads etc for SEO? (Like there are so many products out there..)
I think the more you can say the more probable you'd get someone interested...
if you are talking about seo crawlers, thing is many great tools are also doing this job, and offer something else in addition.
Like ahrefs, semrush..... they are doing seo crawling AND keyword analysis, backlinks,....
I'm actually pay for ahrefs because as seo, they offering me the full package (audit seo, serp analysis...)
And about only crawling, screaming frog is doing an excellent job for less than 200$/year
I'm not really in your target in fact, because i'm still using other seo tools, but a service for installing in a cloud screaming frog could be very interesting.
Like selling a package for a full setup (vps+key+install+guide) of screaming frog in a server/vps to avoid using laptop CPU
I'm looking for a project right now, I like developing web crawlers, but there's just not enough info about it to looks interesting.