For bulk scraping, there are many tools out there.
We have yet to decide which ones to use, but our favorite ones are urlprofiler and urlbox.
It will take time to build this in-house, so we are more likely to use a tool here.
In the meantime, we know that there are many similar solutions, such as saasframe.io, and saaspages.xyz.
We are checking their weaknesses and will focus on those features to include our website. First of all, it's going to be a directory. Later on, we might turn this into a subscription-based business.
Please let us know if anyone tried urlprofiler or urlbox before.