Which is the best database for real-time reporting BI tool?
Hi Indiehackers,
I am building a real-time reporting Side project to solve a specific problem like Heap or MixPanel. Which is the best database to use for this specific requirement. These are the list am considering right now.
- Elastic search
- Postgres
- MongoDB
Going to build this solution in Node.JS. Can you folks suggest me a highly effective database service for this purpose.
Thanks.
You can have any database to store data and pull it realtime. Obviously scaling is different depending on the database and datasets.
If it's going to be time series, you could checkout a time series database https://en.wikipedia.org/wiki/Time_series_database which would be a good match for something like MixPanel.
However, if you're just looking to get started quickly and test out a concept, personally, I wouldn't get hung up on what database to use right now. Just pick one you're familiar with and start building. You can always change it later.
Thanks for the suggestion Jay. Changing the database later would be an extra engineering effort if that's going to handle a lot data flow. That is my major concern. But yeah to get started working with the familiar one would be fine.
I think another way to word what @JaySignorello is saying here is that you should choose a db that is good enough for now that you know. Then you can be productive upfront.
If you end up with a good product that surpasses the ability to scale using the db you choose then that is a good problem to have! You are successful and can solve that problem when it becomes reality, but don't try to optimize everything up front before you even know if your product is going to take off.
Yes it's always better to optimize later once we find product market fit. Thanks @kotojo
I read on hackernews that heap uses citus data which is an extension of Postgres for their service so you can check it out. Also, there is clickhouse which is used by Yandex and is built specifically for this purpose.
Hi @arsalank01 I will check them. Thanks a lot for your suggestion.