I inadvertently wrote some code for scraping real estate websites. Curious to know if there are people here who have some ideas about how I could monetize it.
Right now it effectively scrapes single pages that the user provides. It won't be to hard to enable crawling so that from one page it discovers others and scrapes those too.
This comment was deleted 7 years ago
Actually a great reply, thanks ;)
I wonder how I'd go about finding end users for that. I have worked real estate agents are they are very tight with their money - will be hard to sell such a tool to them.
Could be interesting to have it as a tool which people searching for new homes could access directly. The difficulty there would be getting a sufficiently high volume of listings. Most of the larger websites will ban any scrapers after a certain number of requests. There will also be legal issues around using the data that way.
I considered implementing the code as a chrome extension as that would get me around some the legal issue ( I think ) but I'm not entirely convinced I'll be able to get enough users to justify the effort.
This comment was deleted 7 years ago
Okay, I see what you mean. I'll look into that. Will be interesting to hear from others who might be interested in working on it with me.