Need a feedback on an idea - web scraping

I think you may need to spend more time on understanding the market, ICP than jumping into this. Go slow, get more idea on the web scraping niche before you get in there. Not just for this, for any niche - you should give a little bit time to understand more about the market. Micro SaaS Ideas can help you with this. I have built this and now close to 30K subscribers use this.

While I agree with other folks that you should know the market before getting too deep… I think the best way to learn the industry is by digging into the idea or concept that you want to work on and actually starting to build out the concept because it’s way easier to stay engaged if you are both actively prototyping and conceiving and also researching the market to see how you might fit. You may burn through more iterations this way but as an engineer myself, I find it harder to spend the upfront time just doing research knowing that as I encounter hurdles, I will inevitably uncover the players and the market as I go.

I would argue that if you want to build a tool for someone you should first identify who that person is. If you ask at a public forum what data should be extracted you are giving away power over your future product to someone else.

A better approach is to research online what web scrapping tools are there. Check the reviews they get (for instance on trustpilot) and focus on the bad reviews. Try to see if the complaints are general, like "it does not give me e-mail addresses when I scrap XX website". Then, you'll have a clear indication of what you could build for someone. Then, with that information, you can come back and ask a more focused question, like "what do you think about a web scrapper that provides X-type of results?" You can focus on pitfalls, perhaps products that address the problem you've overlooked, etc. and you will be able to capture the most value out of this community.