Instagator: Universal data collection and aggregation platform

Hi everyone. I'm a long time lurker and I finally got the courage to post one of my product ideas! I have been working on the concept and architecture for this for weeks, but I realized that I really ought to get some validation before I run too far with it.

I'll save you the story if you want to check out the page now, but as a disclaimer this is a very early landing page that is (maybe too) high level for the scope of what the product is planned to cover. The pricing model is totally placeholder as well. I'm hoping I can get some feedback to improve it if it is worthwhile to do so:

https://instagator.io

Instagator, a play on "instant aggregator", is a universal data collection and aggregation platform. A couple of years ago, a friend of mine asked me for help creating an aggregation product for his business. At the time I didn't think much of it and started building a generic data collection framework that could pull from numerous sources and load the timestamped data into our database. I then created APIs to search and access the data, complete with a front-end that users could use to search all the data.

Fast-forward to this year where reflecting on all that work honestly bugged me a lot. It seems that, like clockwork, almost every business sector has room either for an aggregation product, or a product that requires data aggregation. Flights, cars, reviews, games, background checks & screening, etc. I have another friend working at a startup with a data driven product that had the same complaints as I did - it is just far too tiresome to build the code, infrastructure, and reporting for data collection time after time.

It not only takes mountains of energy to achieve this mundane-but-critical goal in every sector, but even thinking about creating an aggregation product usually requires a well-rounded engineer - it is a hard business to get into for a non-technical founder that may have a great, data-driven idea.

So, I had the crazy idea to try to commoditize this beast. In a nutshell, the proposed platform enables you do to the following:

1. Choose or create a data source / integration

The team at Instagator will produce data source integrations for the most popular data sources and properties. What is most popular is a WIP pending further feedback and by request, but these options take the following general forms in most cases, in order of preference:

I) API calls
II) Crawling
III) Humans

There are countless services to enable web scraping, for example, but scraping is only a small part of the picture for many businesses. Most aggregation products benefit from a mix of these, depending on time, money, and technical proficiency of the founder.

Failing you finding what you want, which will honestly probably be the case in many instances especially at the beginning, you can commission the team at Instagator to create your integration, or provide (and share!) one in any programming language of your choice. We provide hooks that you can interface with to dump us the data during your collection, which leads to...

1. Collect the data

The collection routines have to run somewhere, usually on a schedule. Our platform will schedule your collection runs as you desire and run them to completion with varying levels of parallelism depending on plan and what you permit.

1. Query the data

Well, we've got the data but now what? Call out what the fields of your records are and we will automatically provide APIs to access and query all of your records, irrespective of how or when they were collected. This will be the final stop for many that are technically proficient as they may opt to develop their own UI components

1. Displaying the data - the cherry on top

If you are non-technical or don't mind the stock look, we provide widgets that can be embedded in your own web page, fully hooked up to your private APIs out of the box.

To conclude, it's early days for this project. I feel confident there would be demand for a product like Instagator given how prevalent the business model and need is, but I am reaching out to the Indie Hackers community for feedback or suggestions to refine this.

If you can, be nice, but most of all, please be honest!

Thanks

Edit - Due to some feedback I received, I'll be adding a business-specific use case section to demonstrate the kind of products Instagator may help build as currently envisioned. I will also be trying to incorporate some kind of integration list/visibility system that people can vote on. Hopefully this will, if nothing else, let others see what kind of work is being repeated among different teams doing data collection.

Edit 2 - FYI there is no listed proposed free or trial tier on the page as of today, but the intention IS to have at least an unlimited paid trial option for something like 14 days after I do some more research. I've never bought something I couldn't try and I expect the same from everyone else.